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Annual Technical Progress Report 


INTRODUCTION: 

Posttraumatic stress disorder (PTSD) is considered a major public health problem 
in the U.S. because it has fairly high prevalence and because people with PTSD often 
have problems with their work, relationships, and health. There are effective treatments 
for PTSD, such as prolonged exposure therapy (which works by inviting people to revisit 
their memories of traumatic events and to face objectively safe situations they have 
avoided). However, individuals with PTSD may not get the treatment they need because 
they live in rural locations with no trained clinicians or because they have transportation 
problems (for example, the distance makes frequent travel unfeasible or they cannot 
afford gas). Some individuals with PTSD do not feel comfortable driving (due to fears of 
roadside bombs) or they may feel uncomfortable in fonnal hospitals or other crowded 
places. One new method of giving treatments is by using interactive video equipment 
(called "telemedicine"), so that the patient and his therapist can talk with each other and 
see each other over a monitor (like a two-way television screen). 

The goal of the study is to compare exposure therapy in a usual fonnat (face-to- 
face, in-person therapy) to the therapy in a telemedicine fonnat. This project will help 
determine whether telemedicine can be used to provide needed therapies to veterans with 
PTSD in remote locations. 

Two hundred ten (210) military veterans with PTSD will receive exposure 
therapy either by telemedicine or in-person care. Veterans will be enrolled from the 
primary care and mental health clinics at the San Diego VA Healthcare System. Therapy 
will be provided over 12 weekly sessions lasting 90 minutes each. PTSD symptoms will 
be measured before treatment begins, at the completion of therapy, and at a 6 month 
follow-up assessment. Learning and memory tests will be given before treatment begins 
to examine whether cognitive functioning influences treatment outcome, and at the end of 
therapy veterans and therapists will be asked how satisfied they were with each type of 
treatment. 

BODY: 

In the "San Diego Telemedicine Exposure Project" (STEP), we remained focused 
on recruitment and retention of subjects while providing psychotherapy in both in-person 
and telemedicine formats. The PlusUp funding allowed us to re-start recruitment and 
enhance the power of the results. We were able to retain key staff. As we had noted in 
past reports, one of the primary challenges for recruitment included the challenge of there 
being several concurrent treatment studies for PTSD. We expected recruitment to be 
strong after several of those competing studies ended, and we are pleased to report that 
this has been the case. 

Progress: 

At our last Annual Report, we had been referred 387 veterans and had randomized 
143 veterans. We have now been referred 626 veterans. 
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Of the 626 referred, including 479 men (77%) and 147 women (23%), 195 
veterans (31% of those referred) have been randomized to the study. This means that we 
need only randomize an additional 15 veterans to meet our recruitment goal, and we are 
on target to do so. As we have mentioned in previous reports, this is one of the largest 
psychotherapy trials for PTSD. Of the 195 randomized participants, 30 (15.5%) are 
currently in Prolonged Exposure therapy, 110 (56.5%) have completed therapy, and 55 
(28%) have dropped out of therapy. 

The 55 who dropped out included 6 who dropped out before their first therapy 
session due to scheduling conflicts, 7 who dropped out during therapy because of 
scheduling conflicts, 14 who stopped attending their sessions for unknown reasons and 
did not respond to phone calls and letters from study personnel, 15 who reported not 
feeling able to continue with the imaginal exposure component of treatment, 6 who cited 
personal problems interfering with participation, 3 who were tenninated due to lack of 
attendance and treatment adherence, 1 who dropped out due to medical complications, 1 
who had an unplanned move out of state, and 1 who dropped out after technological 
problems occurred during a session, and 1 dropped out due to lack of transportation. 

Of the 195 who were randomized, 150 (77%) are men, and 45 (23%) are women. 
The racial/ethnic information for the 195 randomized veterans is as follows: 110 (56.5%) 
identify as Caucasian, 36 (18.5%) identify as African American, 29 (15%) identify as 
Hispanic/Latino, 10 (5%) identify as Asian, 5 (2.5%) identify as Native Hawaiian/Pacific 
Islander, 4 (2%) identify as Native American/Alaskan Native, and 1 (.5%) is unknown. 

Of the 626 referred, 431 (69%) have not been randomized to the study. Of those 
not randomized to the study, 331 (77%) chose not to enroll in the study (176 declined 
after hearing the study description, and 155 were eligible after the initial phone screen, 
but later declined to participate), 47 (11%) were not eligible after the initial phone screen, 
22 (5%) have been contacted by study staff, but have not returned calls, 7 (1.5%) have 
pending baseline assessments to detennine study eligibility, 7 (1.5%) were unreachable 
by study staff, 6 (1.5%) are on a “medication hold” and will be contacted after becoming 
2 months stable on new medications, 5(1%) are on a “therapy hold” and will be 
contacted after completing therapy, 4(1%) asked to be contacted at a later date, and 2 
(.5%) are on a “sobriety hold” and may be considered for enrollment after remaining 
dependence-free for 3 months. 

By design, the eligibility criteria for this project are broad so that findings will 
apply to most veterans with PTSD (different eras, different trauma types, etc.). We are 
pleased that we have a small rate of veterans excluded based on eligibility, and more than 
one third of the veterans referred to the study have been randomized to treatment (a 
higher rate than many similar studies). In the past year, two of our study assessors moved 
to obtain additional training, but we were able to find and train a replacement so that 
there was little interruption to enrollment. 

We have maintained approval for the study through the UCSD Human Research 
Protections Program, the VA Research and Development Subcommittee, and Karen 
Eaton, MS, at the Human Research Protection Office (HRPO), Office of Research 
Protections (ORP), United States Anny Medical Research and Materiel Command 
(USAMRMC). 
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Again, the 195 veterans we have recruited so far represents one of the largest 
psychotherapy studies for PTSD ever conducted (see Bradley et al, 2005, for a meta¬ 
analysis and comparison of sample sizes). This large sample is sufficient to make several 
important contributions to the literature, including whether cognitive deficits at the 
beginning of treatment will impact clinical outcome in both conditions and a number of 
other issues that cannot be addressed in smaller projects (e.g., examining age, sex, and 
ethnicity as predictors of outcomes). 

The PI is in frequent contact with other researchers in this area (e.g., Drs. Ron 
Acierno, Leslie Morland, Peter Shore, and Peter Tuerk) so that we can exchange best 
practices regarding PTSD assessment and treatment and the provision of services via 
videoconferencing. Our two publications on this topic (Backhaus et ah, 2012 - Thorp is 
corresponding author; Thorp et al., 2012) continue to generate citations, reflecting their 
utility in this field. VA Central Office (VACO) asked the PI to participate on the 
Committee to Develop the Appendix to the VHA Telemental Health Operations Manual 
for Delivery of Evidence-Based Psychotherapy for PTSD. Additionally, through an 
invitation from VACO, the PI has been a member of the National Workgroup to Develop 
the VHA Workshop and Training Video for Delivery of Evidence-Based Psychotherapy 
for PTSD via Telemental Health. On a separate workgroup, we are developing an 
Internet-based training for providers who plan to deliver services for PTSD via 
Telemental Health. The PI is also on the Telemental Health Steering Committee at the 
San Diego VA, and our team has worked very closely with the San Diego VA clinical 
telemedicine team in an effort to educate clinicians about telemedicine. The PI attends the 
monthly meetings of this Committee to update telemedicine staff about our research 
progress and to exchange ideas (and conduct equipment troubleshooting) with the team. 
Our telemedicine research accounts for 30% of the telemedicine activity at the San Diego 
VA. The PI is the Prolonged Exposure (PE) therapy consultant for the study therapists, 
and we have two consultation meetings each week to discuss cases. The PI continues to 
co-sign each therapist’s notes to monitor adherence to protocols and any safety issues, 
and he is one of only 16 VA PE Trainers nationally (another training for 8 VISNs in the 
VA is scheduled for September 2013). In addition to facilitating 4-day trainings for VA 
clinicians, the PI consults with clinicians nationally (listening to their therapy tapes and 
giving specific feedback) on cases each week to maintain his expertise in the treatment. 

See Reportable Outcomes below for a list of the Pi's involvement in publications, 
presentations, grants, and committees. 

KEY RESEARCH ACCOMPLISHMENTS: 

• We obtained additional funding through the DoD PlusUp mechanism so that we can 
reach our target sample size of 210 veterans. 

• We continued the recruitment, screening, assessment, and treatment of subjects. 

• We obtained 626 referrals to the study, and 195 veterans have been randomized to 
treatment. 

• We maintained approval from all human subjects committees (VA, UCSD, and 
HRPO) to continue the project. 
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• We disseminated research findings and practice guidelines through publications and 
presentations (locally and nationally). 

• The PI presented at several scientific conferences and met with colleagues to discuss 
additional ways to improve the methods of this project (see list in Reportable 
Outcomes). 

• The PI continued to build expertise in Prolonged Exposure (PE) therapy, including 
running 4-day trainings and being the consultant in weekly consultation teams each 
week. 

REPORTABLE OUTCOMES: 

Listed below are over 50 publications (peer reviewed and invited) and presentations from 

the past year (selected from over 100 presentations) by the PI. 

PUBLICATIONS 


Peer-Reviewed Publications (* = Corresponding Author) 

1. Wetherell, J. L., Palmer, B. W., Thorp, S. R., Patterson, T. L., Golshan, S., & 
Jeste, D. V. (2003). Anxiety symptoms and quality of life in middle-aged and 
older outpatients with schizophrenia and schizoaffective disorder. Journal of 
Clinical Psychiatry, 64, 1476-1482. PMID: 14728110 

2. *Thorp, S, R., Krause, E. D., Cukrowicz, K. C., & Lynch, T. R. (2004). 
Postpartum partner support, demand-withdraw communication, and maternal 
stress. Psychology of Women Quarterly, 28, 362-369. 

3. Wetherell, J. L., Thorp, S. R., Patterson, T. L., Golshan, S., Jeste, D. V., & Gatz, 
M. (2004). Quality of life in geriatric generalized anxiety disorder: A preliminary 
investigation. Journal of Psychiatric Research, 38, 305-312. PMID: 15003436 

4. *Thorp, S. R., O’Donohue, W. T., & Gregg, J. (2005). The predoctoral 
internship: Is current training anachronistic? Professional Psychology: Research 
and Practice, 36, 16-24. 

5. Wetherell, J. L., Sorrell, J. T., Thorp, S. R., & Patterson, T. L. (2005). 
Psychological interventions for late-life anxiety: A review and early lessons from 
the CALM Study. Journal of Geriatric Psychiatry and Neurology, 18, 72-82. 
PMID: 15911935 

6. Carson, J. W., Keefe, F. J., Lynch, T. R., Carson, K. M., Goli, V., Fras, A. M., 

& Thorp, S. R. (2005). Loving-kindness meditation for chronic low back pain: 
Results from a pilot trial. Journal of Holistic Nursing, 23, 287-304. PMID: 
16049118 

7. Rosenthal, M. Z., Cheavens, J. S., Compton, J. S., Thorp, S, R., & Lynch, T. R. 
(2005). Thought suppression and treatment outcome in late-life depression. Aging 
and Mental Health, 9, 35-39. PMID: 15841830 

8. Carson, J. W., Keefe, F. J., Goli, V., Fras, A. M., Lynch, T. R., Thorp, S, R., & 
Buechler, J. L. (2005). Forgiveness and chronic low back pain: A preliminary 
study examining the relationship of forgiveness to pain, anger, and psychological 
distress. Journal of Pain, 6, 84-91. PMID: 15694874 

9. Lynch, T. R., Cheavens, J. S., Cukrowicz, K. C., Thorp, S, R., Bronner, L., & 
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Beyer, J. (2007). Treatment of older adults with co-morbid personality disorder 
and depression: A dialectical behavior therapy approach. International Journal of 
Geriatric Psychiatry, 22, 131-143. PMID: 17096462 

10. Wetherell, J. L., Kim, D. S., Lindamer, L. A., Thorp, S. R., Hawthorne, W., Kim, 
K., Hough, R. L., Garcia, P., & Jeste, D. V. (2007). Anxiety disorders in a public 
mental health system: Clinical characteristics and service use patterns. Journal of 
Affective Disorders, 104, 179-183. PMID: 17408752 

11. Ayers, C. R., Sorrell, J. T., Thorp, S. R., & Wetherell, J. L. (2007). Evidenced- 
based treatments for late-life anxiety. Psychology and Aging. 22, 8-17. PMID: 
17385978 

12. Simmons, A., Paulus, M. P., Thorp, S, R., Matthews, S. C., Norman, S. B., & 
Stein, M. B. (2008). Functional activation and neural networks in women with 
posttraumatic stress disorder related to intimate partner violence. Biological 
Psychiatry, 64, 681-690. PMID: 18639236 

13. Cukrowicz, K. C., Franzese, A. T., Thorp, S, R., Cheavens, J. S., & Fynch, T. R. 
(2008). Personality traits and perceived social support among depressed older 
adults. Aging & Mental Health, 12, 665-672. PMID: 18855183 

14. Bormann, J. E., Thorp, S., Wetherell, J. F. & Golshan, S. (2008). A spiritually- 
based group intervention for combat veterans with PTSD: Feasibility study. 
Journal of Holistic Nursing, 26, 109-116. PMID: 18356284 

15. Thorp, S. R., Ayers, C. R., Nuevo, R., Stoddard, J. A., Sorrell, J. T., & Wetherell, 
J. F. (2009). Meta-analysis comparing different behavioral treatments for late-life 
anxiety. American Journal of Geriatric Psychiatry, 17, 105-115. PMID: 

19155744 

16. Twamley, E. W., Allard, C. B., Thorp, S. R., Norman, S. B., Cissell, S. H., 
Berardi, S. H., Grimes, E. M., & Stein, M. B. (2009). Cognitive impairment and 
functioning in PTSD related to intimate partner violence. Journal of the 
International Neuropsychological Society, 15, 879-887. PMID: 19703324 

17. Wetherell, J. F., Ayers, C. R., Sorrell, J. T., Thorp, S. R., Nuevo, R., Belding, 

W., Gray, E., Stanley, M. A., Arean, P. A., Donohue, M., Unutzer, J., Ramsdell, 

J., Xu, R., & Patterson, T. F. (2009). Modular psychotherapy for anxiety in older 
primary care patients. American Journal of Geriatric Psychiatry, 17, 483-492. 
PMID: 19461257 

18. Fonzo, G. A., Simmons, A. N., Thorp, S. R., Norman, S. B., Paulus, M. P., & 
Stein, M. B. (2010). Exaggerated and disconnected insular-amygdalar blood 
oxygenation level-dependent response to threat-related emotional faces in women 
with intimate-partner violence posttraumatic stress disorder. Biological 
Psychiatry, 68, 433-41. PMID: 20573339 

19. Nappi, C. M., Drummond, S. P. A., Thorp, S. R., & McQuaid, J. M. (2010). 
Effectiveness of imagery rehearsal therapy for the treatment of combat-related 
nightmares in veterans. Behavior Therapy, 41, 237-44. PMID: 20412888 

20. Wetherell, J. F., Afari, N., Ayers, C. R., Stoddard, J. A., Ruberg, J., Sorrell, J. 

T., Fiu, F., Petkus, A. J., Thorp, S. R., Kraft, A., & Patterson, T. F. (2011). 
Acceptance and Commitment Therapy for generalized anxiety disorder in older 
adults: A preliminary report. Behavior Therapy, 42, 127-134. PMID: 21292059 
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21. *Sones, H. M., Thorp, S. R., Raskind, M. A. (2011). Prevention of posttraumatic 
stress disorder. Psychiatric Clinics of North America. 34, 79-94. PMID: 21333841 

22. *Thorp, S. R., Sones, H. M., Glorioso, D„ Thompson, W., Light, G. A., Golshan, 
S., & Jeste, D. V. (2012). Older patients with schizophrenia: Does military 
veteran status matter? American Journal of Geriatric Psychiatry, 20, 248-256. 
PMID: 22354115 

23. *Thorp, S. R., Stein, M. B., Jeste, D. V., Patterson, T. L., & Wetherell, J. L. 
(2012). Prolonged exposure therapy for older veterans with posttraumatic stress 
disorder: Pilot study. American Journal of Geriatric Psychiatry, 20, 276-280. 

Note: This paper was one of the top 10 most cited articles in the journal (AJGP) 
in 2012. 

24. *Thorp, S. R., Fidler, J., Moreno, L., Floto, E., & Agha, Z. (2012). Lessons 
learned from studies of psychotherapy for PTSD via video teleconferencing. 
Psychological Sendees, 9, 197-199. 

25. *Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., Rice- 
Thorp, N. M., Lohr, J., & Thorp, S. R.. (2012). Videoconferencing 
psychotherapy: A systematic review. Psychological Sendees, 9, 111-131. 

26. *Thorp, S. R. & Blazer, D. G.. (2012). Time does not heal all wounds: Trauma, 
stress, and resilience among older adults. American Journal of Geriatric 
Psychiatry, 20, 375-379. PMID: 22441506 

27. Aupperle, R. L., Allard, C. B., Grimes, E. M., Simmons, A. N., Flagan, T., 
Behrooznia, M., Cissell, S. H., Twamley, E. W., Thorp, S. R., Norman, S. B., 
Paulus, M. P., & Stein, M. B. (2012). Dorsolateral prefrontal cortex activation 
during emotional anticipation and neuropsychological performance in 
posttraumatic stress disorder. Archives of General Psychiatry, 69, 360-371. 

PMID: 22474105 

28. Mohlman, J., Bryant, C., Lenze, E. J., Stanley, M. A., Gum, A., Flint, A., 
Beekman, A. T. F., Wetherell, J. L., Thorp, S. R., & Craske, M. G. (2012). 
Improving recognition of late life anxiety disorders in Diagnostic and Statistical 
Manual of Mental Disorders, Fifth Edition: Observations and recommendations of 
the Advisory Committee to the Lifespan Disorders Work Group. International 
Journal of Geriatric Psychiatry, 27, 549-556. 

29. Bormann, J. E., Liu, L., Thorp, S. R., & Lang, A. J. (2012). Spiritual well-being 
mediates PTSD change in veterans with military-related PTSD. International 
Journal of Behavioral Medicine, 19, 496-502. 

30. Bormann, J. E., Thorp, S. R., Wetherell, J. L., Golshan, S. & Lang, A. J. (2012). 
Meditation-based mantram intervention for veterans with posttraumatic stress 
disorder: A randomized trial. Psychological Trauma: Theory, Research, Practice, 
and Policy, doi: 10.1037/a0027522 

31. *Schuitevoerder, S., Rosen, J. W., Twamley, E. W., Ayers, C. R., Sones, H., 

Lohr, J. B., Goetter, E. M., Fonzo, G. A., Holloway, K. J., & Thorp, S. R. (in 
press). A meta-analysis of cognitive functioning in older adults with PTSD. 
Journal of Anxiety Disorders, doi: 10.1016/j.janxdis.2013.01.001 

32. Bryant, C., Mohlman, J., Gum, A., Stanley, M., Beekman, ATF, Wetherell, J., 
Thorp, S. R., Flint, A.J., Lenze, E.J. (in press). Anxiety disorders in older adults: 
Looking to DSM5 and beyond... American Journal of Geriatric Psychiatry. 
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33. Norman, S. B., Allard, C. B., Trim, R. S., Thorp, S. R., Behrooznia, M., & Stein, 
M. B. (in press). Psychometrics of the Overall Anxiety Severity and Impairment 
Scale (OASIS) in a sample of women with and without trauma histories. Archives 
of Women 's Mental Health. 

34. Wetherell, J. L., Petkus, A. J., Thorp, S. R., Stein, M. B., Chavira, D. A., 
Campbell-Sills, L., Craske, M. G., Sherbourne, C., Bystritsky, A., Sullivan, G., & 
Roy-Byrne, P. (in press). Age differences in treatment response to a collaborative 
care intervention for anxiety disorders in primary care. British Journal of 
Psychiatry 

35. Aupperle, R. L., Allard, C. B., Simmons, A. N., Flagan, T., Thorp, S. R., 
Norman, S. B., Paulus, M. P., & Stein, M. B. (in press). Neural responses during 
emotional processing before and after cognitive trauma therapy for battered 
women. Psychiatry Research: Neuroimaging. 

Invited Publications and Chapters (* = Corresponding Author) 

1. *Thorp, S. R., Gregg, J., Niccolls, R., & O’Donohue, W. T. (2001). The best and 
worst of times for behavioral mental health practice. In N. A. Cummings, V. M. 
Follette, S. C. Hayes, and W. T. O’Donohue (Eds.), Integrated behavioral 
healthcare: Positioning mental health practice with medical/surgical practice. 
San Diego, CA: Academic Press. 

2. *Thorp, S. R., & Fruzzetti, A. E. (2003). Ethics in the science and practice of 
couples and family therapy. In W. T. O’Donohue and K. E. Ferguson (Eds.), 
Handbook of Professional Ethics for Psychologists: Issues, Questions, and 
Controversies (pp. 391-406). Thousand Oaks, CA: Sage Publications, Inc. 

3. *Thorp, S. R., & Stein, M. B. (2005). Posttraumatic stress disorder and 
functioning. PTSD Research Quarterly, 16, 1-7. 

4. *Thorp, S. R. & Lynch, T. R. (2005). Depression and personality disorders - 
older adults. In A. Freeman (Ed. in Chief), S. H. Felgoise, A. M. Nezu, C. M. 
Nezu, & M. A. Reineke (Eds). Encyclopedia of Cognitive Behavior Therapy (pp. 
155-158). New York: Springer. 

5. Rodgers, C. S., Norman, S. B., Thorp, S. R., Lebeck, M. M., & Lang, A. J. 
(2005). Trauma exposure, posttraumatic stress disorder and health behaviors: 
Impact on special populations. In T. A. Corales (Ed.), Focus on Post-Traumatic 
Stress Disorder Research (pp. 203-224). Hauppauge, NY: Nova Science 
Publishers, Inc. 

6. *Thorp, S. R., & Stein, M. B. (2008). Occupational Disability. In G. Reyes, J. 
Elhai, and J. Ford. (Eds.). Encyclopedia of Psychological Trauma (p. 453). 
Hoboken, New Jersey: John Wiley & Sons. 

7. Ayers, C. R., Thorp, S. R., & Wetherell, J. L. (2009). Anxiety disorders and 
hoarding in older adults. In M. M. Antony and M. B. Stein (Eds.), Oxford 
Handbook of Anxiety and Related Disorders (pp. 625-635). New York, NY: 
Oxford University Press. 

8. Norman, S. B., Wilkins, K. G., Baeressen, K., Thorp, S. R., Huelsenbeck, R., 
Grimes, E., Rodgers, C., & Allard, C. (2010). Drinking among female victims of 
intimate partner violence: Mechanisms and intervention. Hauppauge, NY: Nova 
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Science Publishers, Inc. 

9. *Thorp, S. R. (2011). Implementing prolonged exposure in PTSD Clinical Teams 
(PCTs). In A. Eftekhari & J. Crowley (Eds.), Successful Implementation of 
Prolonged Exposure (PE) Therapy in VHA: A Clinic Guidance Manual. [Online 
guide conducting prolonged exposure therapy in VA PTSD Clinical Teams]. 

Available from ah VA computers at: 

http://vaww.infoshare.va.gov/sites/pe/Lists/Useful%20Materials%20%20Informat 

ion/Ahltems ,aspx?Page V iew=Shared 

10. *Thorp, S. R., Sones, H. M., & Cook, J. M. (2011). Posttraumatic stress disorder among 
older adults. In K. H. Sorocco & S. Lauderdale (Eds.), Cognitive behavior therapy with 
older adults: Innovations across care settings (pp. 189-217). New York, NY: Springer 
Publishing Company. 

11. *Thorp, S. R., Sones, H. M., & Cook, J. M. (2011). Prolonged exposure therapy for 
older combat veterans in the Veterans Affairs Healthcare System. In K. H. Sorocco & S. 
Lauderdale (Eds.), Cognitive behavior therapy with older adults: Innovations across care 
settings (pp. 421-442). New York, NY: Springer Publishing Company. 

12. Thorp, S. R. & Cook, J. M. (in press). Trauma and PTSD in older veterans. Trauma 
Psychology News, the newsletter published by Division 56 of the American 
Psychological Association (APA). 

Other Published Work (* = Corresponding Author) 

1. O’Donohue, W. T., & Thorp, S. R. (1996, March). EMDR as marginal science. 

[Review of the Book Eye Movement Desensitization and Reprocessing: Basic 
principles, protocols, and procedures]. The Scientist Practitioner, 5(2), 17-19. 

2. *Thorp, S. R. (2000, Fall). Can we be saved? Relationship Rescue and the 
bashing of couple therapy and theory [Review of the book Relationship Rescue]. 

Couples Research and Therapy, 6(2), 13. 

3. *Thorp, S. R. (2004). [Review of the book Bad therapy: Master therapists share 
their worst failures]. Journal of Psychosomatic Research, 57, 115-116. 

4. *Thorp, S. R. (2004). [Review of the book Science and Pseudoscience in 
Clinical Psychology:]. Journal of Psychosomatic Research, 56, 381. 

5. *Thorp, S. R. (2005). Highlights of the American Association for Geriatric 
Psychiatry 18th Annual Meeting, March 3-6, 2005, San Diego, CA [Conference 
report]. Available at Medscape http://www.medscape.com/viewarticle/501383 1 

6. Chambers, A., Eftekhari, A., Crowley, J., Ruzek, J., Gregory, G., Aosved, A., Castillo, 

D., Thorp, S. R., Telfer, L., Kuhn, E., Foa, E. B., & Hembree, E. (2011). Strategies for 
recruiting veterans for PE. [Online slides for enhancing recruitment to therapy]. 

Available from all VA computers at: 

http://vaww.infoshare.va.gov/sites/pe/Lists/Useful%20Materials%20%20Information/All 

Items. aspx?PageV iew=Shared 

7. *Thorp, S. R., Tuerk, P., & Eftekhari, A. (2011). Guidelines for PE via Telemental 
Health. [Online slides to guide prolonged exposure therapy via telemental health 
technology]. Available from all VA computers at: 

http://vaww.infoshare.va.gov/sites/pe/Lists/Useful%20Materials%20%20Information/All 

Items. aspx?PageV iew=Shared 
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8. Acierno, R., Godleski, L., Karlin, B., Morland, L., Rauch, S., Smith, T., Thorp, S. R., & 
Tuerk, P. (2011). Veterans Health Administration (VHA) Evidence-Based Psychotherapy 
for PTSD Telemental Health Appendix. 

Manuscripts Submitted for Publication (* = Corresponding Author) 

1. *Ross, B. S., Hurst, S., Agha, Z., Floto, E., Maglione, M., & Thorp, S. R. (2013). 
Therapists' views of videoconferencing psychotherapy. Manuscript submitted for 
publication. 

2. Nappi, C. M., Staus, L. D., Norman, S. B., Thorp, S, R., & Drummond, S. P. A. 

(2013). Recruitment and retention rates and the strategies used to promote them: 

Lessons learned from an OEF/OIF/OND prolonged exposure research trial. 

Manuscript submitted for publication. 

3. *Sones, H. M., & Thorp, S. R. (in preparation). The effect of maternal PTSD on 
children. 

Manuscripts In Preparation (* = Corresponding Author) 

1. *Sones, H. M., Malcarne, V., & Thorp, S. R. (in preparation). Measuring the 
positive outcomes of trauma: An empirical review of the psychometric properties 
of the Posttraumatic Growth Inventory. Manuscript being revised for 
resubmission. 

2. *Thorp, S. R., Grimes, E., Allard, C. B., Norman, S. B., & Stein, M. B. (in 
preparation). The role of mindfulness among women who have experienced 
intimate partner violence. 

Published Abstracts, Presentations, and Workshops (Past Year Only) 

1. Thorp, S. R. (January 2012). The future of clinical training in psychology: How 
technology matters. Paper presented at the Council of University Directors of 
Clinical Psychology Midwinter Meeting, San Diego, CA. 

2. Tuerk, P.W. & Thorp, S. R. (February 2012). Providing prolonged exposure for 
PTSD via telemental health. Invited presentation to the VISN 11 PTSD Mentors 
group. 

3. Silberg, J., Thorp, S. R., Caplan, P., Carlton, T., & Nacev, V. (September 2012). 
Developmental, complex, and post-traumatic stress disorder: Controversial issues 
in labeling and intervention. Panel discussion at the 17 th International Conference 
on Violence, Abuse and Trauma (IVAT), San Diego, CA. 

4. Morland, L. A., Thorp, S. R., & Acierno, R. (November 2012). Home-based 
clinical video-teleconferencing for PTSD: A patient centered model. Paper 
presented at the 28th Annual Meeting of the International Society for Traumatic 
Stress Studies (ISTSS), Los Angeles, CA. 

5. Sones, H. M., Moreno, L., Schuitevoerder, S., Fidler, J., Agha, Z., & Thorp, S. R. 
(November 2012). The impact of trauma-related guilt and cognitive appraisal on 
posttraumatic growth in Veterans with PTSD. Poster presented at the 65 th annual 
Gerontological Society of America meeting, San Diego, CA 
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6. Gregory, A.M., Tirabassi, C., Allard, C.B., Norman, S.B., Thorp, S., Stein, M.B., 
& Twamley, E.W. (2013). Cognitive perfonnance and treatment response in 
women with PTSD. Journal of the International Neuropsychological Society, 19 
(SI), 173. (International Neuropsychological Society). 

7. Langley-DeGroot, M., Sones, H. M., & Thorp, S. R. (March 2013). Self-report 
versus clinician-assigned PTSD symptom ratings in a sample of older male 
veterans. Poster presented at the 26 th annual meeting of the American Association 
for Geriatric Psychiatry (AAGP), Los Angeles, CA. 

8. Thorp, S. R. (March 2013). Exposure therapy for older veterans with PTSD. 
Paper presented at the 26 th annual meeting of the American Association for 
Geriatric Psychiatry (AAGP), Los Angeles, CA. 

9. Bormann, J. E., & Thorp, S. (March 2013). Portable Mantram Repetition 
improves spiritual wellbeing in veterans with PTSD. Paper presented at the 34 th 
annual Meeting & Scientific Sessions of the Society of Behavioral Medicine, San 
Francisco, CA. 

10. Bormann, J. E., & Thorp, S, (March 2013). Portable Mantram Repetition 
improves spiritual wellbeing in veterans with PTSD (abstract). Annuls of 
Behavioral Medicine, 45, Supp2, s 181. 

11. Thorp, S. R., Agha, Z., Moreno, L., & Liu, L. (April 2013). Videoconferencing 
psychotherapy for military veterans with PTSD. Paper presented at the 33 rd 
Annual Meeting of the Anxiety Disorders Association of America (ADAA), La 
Jolla, CA. 

12. Moreno, L., Thorp, S. R., Agha, Z., & Liu, L. (April 2013). Treatment 
satisfaction and alliance with posttraumatic stress disorder (PTSD) telemedicine 
psychotherapy for military veterans. Paper presented at the 33 ld Annual Meeting 
of the Anxiety Disorders Association of America (ADAA), La Jolla, CA. 

13. Thorp, S. R., Sones, H. M. (April 2013). Prolonged exposure vs. relaxation for 
older veterans with PTSD. Paper presented at the 33 ld Annual Meeting of the 
Anxiety Disorders Association of America (ADAA), La Jolla, CA. 

14. Repp, A. L., Thorp, S. R., & Agha, Z. (April 2013). Video telemedicine offers 
sign ifican t savings in distance, time and travel costs for veterans with 
posttraumatic stress disorder. Poster presented at the 33 rd Annual Meeting of the 
Anxiety Disorders Association of America (ADAA), La Jolla, CA. 

15. Thorp, S. R. (April 2013). Implementing Internet-mediated exposure therapy for 
various anxiety disorders: Research findings and clinical considerations. 
Discussant for symposium presented at the 33 rd Annual Meeting of the Anxiety 
Disorders Association of America (ADAA), La Jolla, CA. 

16. Robertson, A., Lincoln, A., Agha, Z., & Thorp, S, R. (April 2013). Utility 
elicitation of PTSD specific health-related quality-of-life. Poster presented at the 
33 ld Annual Meeting of the Anxiety Disorders Association of America (ADAA), 
La Jolla, CA. 
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The PI also continues to give local talks to increase awareness of PTSD and 

psychotherapy via teleconferencing (sample from past year): 

1. March 20, 2012 for 40 attendees at SDSU Research Foundation: "PTSD and 
Comorbidities" 

2. April 12, 2012 for 175 students in Careers in Psychology course at SDSU: "Clinical 
Research Careers and PTSD Research." 

3. May 3, 2012 for 50 mental health professionals and trainees in San Diego: "Lessons 
Learned in Providing Psychotherapy for PTSD via Teleconferencing." 

4. September 21 and 28, 2012 for 15 attendees at the PTSD Seminar in VA Healthcare 
System: "Prolonged Exposure Therapy Overview." 

5. December 10, 2012 for 75 attendees on national LiveMeeting for VA: "Prolonged 
Exposure via Telemedicine." 

6. December 14, 2012 for 10 attendees at Grossmont Community College Life Coach 
Seminar: "PTSD Assessment, Treatment, and Resources." 

7. January 10, 2013 for 100 attendees at Grand Rounds for Psychiatry Department at the 
UCSD School of Medicine: "Posttraumatic Stress and Growth in Older Adults." 

8. January 15, 2013 for 20 attendees at Grand Rounds for the Stein Institute for 
Research on Aging (SIRA): "Posttraumatic Stress and Growth in Older Adults." 

9. January 30, 2013 for 360 attendees at Congregation Beth Israel Jewish Family 
Service: "Therapeutic Options for Treating Trauma-Related Symptoms." 

10. February 7, 2013 for 45 attendees at VA national LiveMeeting for Community Living 
Center (nursing home) providers: "PTSD in Later Life" 

11. February 14, 2013 for 40 attendees at VA national LiveMeeting for Home-Based 
Primary Care providers: "Conducting Prolonged Exposure for PTSD with Older 
Adults and in Home Settings" 

12. March 5, 2013 and March 19, 2013 for 40 mental health professionals in the 
community: "Cognitive Behavioral Therapy Skills Training" (12 hour course) 

13. March 12, 2013 for 125 undergraduate students in PSY124 course at UCSD: 
"Cognitive Behavioral Therapy" 

The PI additionally continues to participate in local and national workgroups on 

psychotherapy for PTSD, telemedicine, and related topics. He has also been asked to 

update the media to this work on several occasions. 


Workgroups 


2006-present Anxiety Disorders Research Group 
University of California, San Diego 


2007-present Psychology Internship Training Committee (PITC) 
University of California, San Diego 


2007-present 


Health Services Research & Development Investigators Workgroup 


VA San Diego Healthcare System 


14 



2008- present PTSD Mentorship Program 

VA VISN 22 and National (Central Office) 

2009- present PTSD Clinical Guidance Committee 

VA San Diego Healthcare System 

2009- present Telemental Health Steering Committee 

VA San Diego Healthcare System 

2010- present Collaborative Endeavors Committee 

American Psychological Association, Division 56 (Trauma Psychology) 

2011 -present Committee to Develop Appendix to the VHA Telemental Health 

Operations Manual for Delivery of Evidence-Based Psychotherapy for 
PTSD 

VA Central Office 

2011 -present National Workgroup to Develop VHA Workshop and Training Video for 
Delivery of Evidence-Based Psychotherapy for PTSD via Telemental 
Health 

VA Central Office 

2011 -present Chair, VHA Workgroup to Provide Input to APA on Telepsychology 
Services 

VA Central Office 

2011 -present Advisory Board Member, P2V (Pets to Vets) 

Organization that pairs animals with veterans to facilitate recovery 

2011- 2012 Advisor to the DSM-5 Development Process, DSM-5 Late-Life Anxiety 

Subgroup of the Lifespan Study Group 
American Psychiatric Association 

2011 -present Member, Aging and Trauma Workgroup 
National Center for PTSD 


2011- 2012 Member, Mental Health Service Reorganization Workgroup 

VA San Diego Healthcare System 

2012- present National Workgroup to Develop VHA Online Training for 

Evidence-Based Psychotherapy for PTSD via Telemental Health 
VA Central Office 
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MEDIA COVERAGE 


Nierengarten, M. B., journalist for Medscape Medical News. (April 2009). ADAA 2009: 
Exposure therapy for PTSD may benefit older veterans: Pilot study results show 
promise. Online: http://www.medscape.com/viewarticle/589792 

MacNeil, J. S., journalist for Caring for the Ages. (November 2009). PTSD research 
reaches older veterans. Online: 

http://download.iournals.elsevierhealth.com/pdfs/iournals/1526- 

4114/PIIS1526411409603139.pdf 

Television news interview - CW Channel 6 (March 21, 2010). Posttraumatic stress 
disorder (interview with Dr. Thorp and discussion of PTSD studies). 

Kovach, G. C., journalist for The Union Tribune (newspaper). (April 10, 2010). 

Susceptibility to PTSD focus of conference: Why do some suffer it, while others 
don’t? Online: http://www.signonsandiego.com/news/2010/apr/10/susceptibilitv- 
to-ptsd-focus-of-conference/ 

The following article was chosen as the Research Article of the Day (July 25, 2012) by 
The Practice Institute: http://thepracticeinstitute.com/publications-and- 
products/article-resource-library/research-article-of-the-day 
Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., Rice- 
Thorp, N. M., Lohr, J., & Thorp, S. R. (Thorp is corresponding author). 
(2012). Videoconferencing psychotherapy: A systematic review. 
Psychological Services, 9, 111-131. 

The following article was highlighted in VA Research Currents (March/April 2012): 
http://www.research.va.gov/currents/mar-aprl2/mar-aprl2-02.cfm 

Bormann, J. E., Thorp, S. R., Wetherell, J. L., Golshan, S. & Lang, A. J. (in 
press). Meditation-based mantram intervention for veterans with 
posttraumatic stress disorder: A randomized trial. Psychological Trauma: 
Theory, Research, Practice, and Policy. 

Radio interview with Rick Rogers (August 12, 2012): Front & Center: Military Talk 
Radio, http://defensetracker,com/web/?p=2691 

The following article was highlighted in The February 2013 Clinician 's Trauma Update , 
Issue 7(1) (http://www.ptsd.va.gov/professional/newsletters/ctu-online/ctu V7Nl.pdf) 

and as a feature article in MDLinx.com (http://www.mdlinx.com/psvchiatry/news- 
article.cfm/4417459) : 

Schuitevoerder, S., Rosen, J. W., Twamley, E. W., Ayers, C. R., Sones, H., Lohr, 
J. B., Goetter, E. M., Fonzo, G. A., Holloway, K. J., & Thorp, S. R. (in press). A 
meta-analysis of cognitive functioning in older adults with PTSD. Journal of 
Anxiety Disorders, doi: 10.1016/j .janxdis.2013.01.001 
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Span, Paula, journalist for The New York Times (March 15, 2013). No End to Trauma for 
Some Older Veterans. Online: 

http://newoldage.blogs.nytimes.com/2013/03/15/no-end-to-trauma-for-some- 

older-veterans/ 


Article in VA Research Currents (May 2013): For Veterans with PTSD, 
videoconferencing proves effective for delivering therapy; 
http://www.research.va.gOv/currents/mavl3/mavl3-02.cfm#.UYQhvkpXY7s 

Steele, Jeanette, journalist for The San Diego Union Tribune (May 5, 2013): Face-to- 
Face with PTSD. Online: http://www.utsandiego.com/news/2013/mav/05/tp-face-to-face- 
with-ptsd/?page= 1 #article-copy 

CONCFUSION: 

We feel that we have demonstrated good progress in this past year. The PI has 
become recognized as an expert in psychotherapy via telemedicine through publicly 
disseminating data and lessons learned from this and other projects. We refined our 
recruitment and retention strategies, and we have enrolled 195 veterans so far. We have 
been able to retain most of our highly trained and experienced research staff. We believe 
that this project will add greatly to our knowledge about how best to provide 
psychotherapy to veterans with PTSD at remote locations. 

REFERENCES: 

Bradley R, Greene J, Russ E, Dutra L, Westen D (2005) A multidimensional meta¬ 
analysis of psychotherapy for PTSD. American Journal of Psychiatry 162:214- 
227. 

SUPPORTING DATA: 

None. 

APPENDICES: 

Thorp, S. R., Fidler, J., Moreno, L., Floto, E., & Agha, Z. (2012). Lessons learned from 
studies of psychotherapy for PTSD via video teleconferencing. Psychological Services, 9, 
197-199. 

Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., Rice-Thorp, N. 
M., Lohr, J., & Thorp, S. R. (Thorp is corresponding author). (2012). Videoconferencing 
psychotherapy: A systematic review. Psychological Services, 9, 111-131. 
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Lessons Learned From Studies of Psychotherapy for Posttraumatic 
Stress Disorder Via Video Teleconferencing 
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VA San Diego Healthcare System, San Diego, 
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This article summarizes two ongoing randomized controlled trials that compare individual 
in-person psychotherapy with psychotherapy provided using video teleconferencing for 
military veterans with posttraumatic stress disorder. We describe training methods, popu¬ 
lations, technology, challenges, successes, and lessons learned so far during the trials. 

Keywords: telehealth, telemental health, telemedicine, videoconference, psychotherapy 


Names of Institutions 

The VA San Diego Healthcare System and 
the University of California, San Diego. 

Services Delivered 

Studies of psychotherapy for posttraumatic 
stress disorder (PTSD) in veterans using video 
teleconferencing (VTC). 


Steven R. Thoip, Center of Excellence for Stress and 
Mental Health, VA San Diego Healthcare System, San 
Diego, California, and University of California, San Diego; 
Janel Fidler, Lucy Moreno, and Elizabeth Floto, VA San 
Diego Healthcare System, San Diego, California; and Zia 
Agha, VA San Diego Healthcare System, San Diego, Cal¬ 
ifornia, and University of California, San Diego. 

Supported by the Department of Veterans Affairs, Vet¬ 
erans Health Administration, Office of Research and Devel¬ 
opment (Career Development Award to Dr. Thorp), and 
Health Services Research and Development (award DHI 
07-054-2 to Drs. Agha and Thoip); and supported in part by 
the Department of Defense (award W81XWH-08-2-0076 to 
Dr. Thorp). The views expressed in this article are those of 
the authors and do not necessarily reflect the position or 
policy of the Department of Veterans Affairs or the United 
States Government. 

Correspondence concerning this article should be ad¬ 
dressed to Steven R. Thoip, VA San Diego Healthcare 
System, 8810 Rio San Diego Drive, Mail Stop 116A4Z, San 
Diego, CA 92108. E-mail: sthorp@ucsd.edu 


Type of Professionals Involved 

Twenty-five psychotherapists (doctoral stu¬ 
dents in psychology and psychologists, social 
workers, and marriage and family therapists) as 
well as master’s level assistants. 

Training for Telemental Services 

Study assistants first spoke with experts and 
reviewed documents detailing VTC recommen¬ 
dations. Assistants reassured veterans that the 
VTC connection was secure, they reviewed pos¬ 
sible visual and audio issues that might arise 
during sessions, and, before they left the therapy 
room, they showed veterans where they would 
sit if they were needed during the session. 

Populations Served 

We are conducting two ongoing randomized 
controlled trials that compare psychotherapy us¬ 
ing VTC with in-person psychotherapy for vet¬ 
erans with PTSD. In one study, all veterans 
receive cognitive processing therapy (CPT), 
which teaches the patient how to monitor and 
challenge maladaptive thoughts. In the other 
study, all veterans receive prolonged exposure 
therapy (PE), which helps the patient repeatedly 
face feared (but safe) memories and situations. 
In the CPT study, we have screened 426 veter¬ 
ans and 196 have been randomized to date. The 
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median age is 49 years (range: 22—84), and 
22% are women. Worst identified traumas in¬ 
clude combat (45%), sexual assault (19%), ac¬ 
cident (10%), or other (26%). In addition to 
PTSD, 58% had co-occurring mood disorders 
and 21% had at least one other anxiety disorder. 
In the PE study, we have screened 284 veterans 
and 132 have been randomized. The median age 
is 55 years (range: 23 — 79), and 18% are 
women. Worst identified traumas include com¬ 
bat (52%), sexual assault (18%), accident 
(11%), or other (19%). In addition to PTSD, 
72% had co-occurring mood disorders and 15% 
had at least one other anxiety disorder. 

Geographic Location Served 

San Diego County, California. 

Funding Sources 

U.S. Department of Veterans Affairs (CPT 
study) and the U.S. Department of Defense (PE 
study). 

Technology Used 

We have used Tandberg 550 and LifeSize 
Focus video conferencing systems. We have 
found these systems to be reliable and user 
friendly. For quality control, we record all VTC 
sessions using a digital video recorder, and 
these recordings are stored on our secure VA 
server. We use fax machines to relay question¬ 
naires between veterans and therapists. In the 
PE study, we use laptops to play videos, and 
veterans use digital audio recorders. 

Technology Choices That Would Be 
Different Next Time and Why 

None. 

Use of Electronic Medical Record 

We use an electronic medical record—the 
Computerized Patient Record System—to docu¬ 
ment all clinical services in the VA. When veter¬ 
ans are assigned to VTC, we add a system note 
that they have agreed to this mode of treatment. 


Biggest Challenges 

Challenges in conducting VTC included visual 
artifacts (pixilation, “tracer” images with move¬ 
ment, occasional low image resolution, “choppy” 
or “frozen” images) and audio artifacts (delay, 
echo, “mechanical” voices). Our equipment 
shows veterans from the torso. In one instance, a 
therapist did not realize her veteran was in a 
wheelchair until the third therapy and the therapist 
discovered that the veteran’s wife had assisted 
him during all assigned homework activities. 
Thus, the wheelchair and the wife’s assistance had 
impacted the veteran’s assignments without the 
therapist’s awareness. Fidgeting hands and feet 
can also be missed. Another therapist could not 
tell whether a veteran was sniffling due to a cold 
or to tears. Physical contact, like shaking hands 
and handing tissues to a sobbing client, is not 
possible in VTC. 

Biggest Successes 

Our veterans have expressed satisfaction with 
the decreased travel time, cost savings related to 
purchasing less gasoline, and fewer crowds and 
parking problems at the remote sites. Both vet¬ 
erans and therapists have been patient with the 
technology, and several have reported enjoying 
(even preferring) VTC sessions. 

Lessons Learned 

We have learned how proper orientation to 
equipment and administrative support at each site 
can put both therapists and veterans at ease. We 
have provided therapists with phone numbers and 
physical addresses for the veterans and study as¬ 
sistants at remote sites to help manage potential 
crises (to direct emergency personnel). We have 
learned to use a blue screen backdrop at each site, 
good lighting, and enough distance from the cam¬ 
era (with zoomed lens) to allow for the perception 
of eye contact. Heavy chairs minimize off-screen 
movement. We have learned to systematically 
monitor call quality to adjust the bandwidth 
needed, and that rebooting the equipment solves 
many problems. Some veterans have reported 
heightened concerns about the security of the 
video transmissions, and some have been wary of 
other people, noises, or items in the therapist’s 
room. Others have expressed a preference for the 
remote nature of VTC because they could “lower 
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[their] guard.” Therapists have reported good rap¬ 
port, despite the fact that they do not meet veter¬ 
ans in person before starting treatment using VTC. 
Several therapists have expressed a preference for 
VTC when veterans are physically intimidating or 
have contagious illnesses. Therapists have also 
mentioned that it is easier to end sessions on time 


in VTC because the discussion is more focused 
and the equipment is turned off at the designated 
end time. 
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Autumn Backhaus 

VA San Diego Healthcare System, San Diego, 
California 


Zia Agha 

VA San Diego Healthcare System, San Diego, 
California and University of California, San Diego 


M elissa L. M aglione, Andrea Repp, Natalie M . Rice-Thorp 

Bridgett Ross, and Danielle Zuest University of California, San Diego 

VA San Diego Healthcare System, 

San Diego, California 

James Lohr and Steven R. Thorp 

VA San Diego Healthcare System, Center of Excellence for Stress and M ental Health, San Diego, California 

and University of California, San Diego 

Individuals with mental health problems may face barriers to accessing effective 
psychotherapies. Videoconferencing technology, which allows audio and video infor¬ 
mation to be shared concurrently across geographical distances, offers an alternative 
that may improve access. We conducted a systematic literature review of the use of 
videoconferencing psychotherapy (VCP), designed to address 10 specific questions, 
including therapeutic types/formats that have been implemented, the populations with 
which VCP is being used, the number and types of publications related to VCP, and 
available satisfaction, feasibility, and outcome data related to VCP. After electronic 
searches and reviews of reference lists, 821 potential articles were identified, and 65 
were selected for inclusion. The results indicate that VCP isfeasible, has been used in 
a variety of therapeutic formats and with diverse populations, is generally associated 
with good user satisfaction, and is found to have similar clinical outcomes to traditional 
face-to-face psychotherapy. Although the number of articles being published on VCP 
has increased in recent years, there remains a need for additional large-scale clinical 
trials to further assess the efficacy and effectiveness of VCP. 

Keywords: telehealth, telemental health, telemedicine, videoconference, psychotherapy 


One out of every four adults in the United 
States meets criteria for a mental disorder 
(WHO World Mental Health Survey Consor¬ 


tium, 2004), but only 13.4% of adults in the 
U.S. receive mental health treatment (National 
Institute of Mental Health, 2011). Many types 


Autumn Backhaus, Psychology Service, VA San Diego 
Healthcare System; Zia Agha, Department of Family M ed- 
icine, VA San Diego Healthcare System and the University 
of California, San Diego; Melissa L. M aglione, Andrea 
Repp, Bridgett Ross, and DanielleZuest, Research Service, 
VA San Diego Healthcare System; Natalie M. Rice-Thorp, 
Counseling and Psychological Services, University of Cal¬ 
ifornia, San Diego; James Lohr, Psychiatry Service, VA 
San Diego Healthcare System Center of Excellence for 
Stress and Mental Health and Department of Psychiatry, 
the University of California, San Diego; Steven R. Thorp, 
Research Service and Psychology Service, VA San Diego 
Healthcare System Center of Excellence for Stress and 
Mental Health and Department of Psychiatry, the Univer¬ 
sity of California, San Diego. 


This material is based on work supported by the Depart¬ 
ment of Veterans Affairs, Veterans Health Administration, 
Office of Research and Development (Career Development 
Award to Dr. Thorp from Clinical Science Research and 
Development and Merit Review Award DH107-054-2 to 
Drs. Agha and Thorp from Health Services Research and 
Development) and the Department of Defense (W81X WH- 
08-2-0076) to Dr. Thorp. All views and opinions expressed 
herein are those of the authors and do not necessarily 
reflect those of our respective institutions, the Department 
of Veterans Affairs, or the Department of Defense. 

Correspondence concerning this article should be ad¬ 
dressed to Steven R. Thorp, VA San Diego Healthcare 
System, 8810 Rio San Diego Drive, Mail Code 116A4Z, 
San Diego, CA 92108. E-mail: sthorp@ucsd.edu 


111 



112 


BACKHAUS ET AL. 


of psychotherapies have been demonstrated to 
be effective in treating mental disorders, yet 
practical and psychological factors often pre¬ 
vent patients from receiving mental health care 
(Olden, Cukor, Rizzo, Rothbaum, & Difede, 
2010). One such factor is the location in which 
mental health services are available. In the 
United States, 77% of the counties have a se¬ 
vere shortage of mental health professionals 
(Thomas, Konrad, Holzen, & M orrissey, 2009). 
Another factor is that relatively few providers 
are trained in the therapies with the greatest 
empirical support (Shapiro, Cavanagh, & Lo¬ 
mas, 2003; Van den Berg, Shapiro, Bicker- 
staffe, & Cavanagh, 2004), and most of those 
trained specialists reside in metropolitan areas 
(Wallace, Weeks, Wang, Lee, & Kazis, 2006). 
This can greatly limit access to care for indi¬ 
viduals living in rural areas. 

M any individuals do not have the means to 
travel great distances to seek specialized mental 
health services, and this problem is com¬ 
pounded during times of economic crisis or high 
fuel prices. In addition, the nature of many 
mental disorders leads patients to avoid anxiety- 
provoking situations such as large groups of 
people (e.g., urban centers, hospitals) and trav¬ 
eling on roads (e.g., driving phobias after acci¬ 
dents or roadside bomb attacks). Individuals 
may be more inclined to seek treatment in fa¬ 
miliar and convenient community clinics or 
from the comfort of their homes if those options 
are available to them. 

Telehealth refers to the use of technology to 
provide health care when providers are geo¬ 
graphically distant from patients (Field, 1996; 
Schopp, Demiris, & Glueckauf, 2006). Many 
mental health professionals use information 
technology such as telephones, e-mail, and web 
forums to communicate with patients. Ad¬ 
vanced technology (e.g., computers, smart 
phones, virtual reality), including videoconfer¬ 
ence (V C) technology, may further enhance ac¬ 
cess to mental health treatment. The VA Health 
Care System has responded to the need for rural 
services for Veterans in part by developing out¬ 
patient clinics and Vet Centers in more sparsely 
populated areas, but the V A has also emerged as 
one of the largest providers of telehealth, in 
fiscal year 2007, there were over 45,000 visits 
for mental health services by telehealth ("tele¬ 
mental health") in the VA system (Godleski, 
Nieves, Darkins, & Lehmann, 2008). Reflecting 


the high volume of clinical visits via telemental 
health in recent years, the number of publica¬ 
tions on telemental health from 2000 to 2008 
was more than triple the number of publications 
from the previous 30 years (Richardson et al., 
2009). However, there appears to be a need for 
more empirical, rather than descriptive, articles. 

Videoconferencing psychotherapy (VCP) is 
one type of telehealth that can offer patients 
improved access to mental health professionals 
with specialized expertise (Mair & Whitten, 
2000). We conducted the current review be¬ 
cause, despite the surge in publications, no re¬ 
views (to our knowledge) have focused solely 
on psychotherapy via videoconferencing. M any 
different terms have been used when describing 
psychotherapy in this format, and we aimed to 
describe those terms while synthesizing the lit¬ 
erature. Furthermore, it has not been clear 
whether articles have been primarily descriptive 
or empirical. Because of the expanding litera¬ 
ture on this topic and the recent publication of 
several excellent clinical trials, we saw a need 
fora specific and updated review. We chose to 
perform a systematic review because our aim 
was to conduct a thorough review of the avail¬ 
able literature, according to a predetermined 
protocol, in order to address very specific re¬ 
search questions (Centre for Reviews and Dis¬ 
semination, 2009; Kitchenham, 2004). Consis¬ 
tent with the goals in conducting a systematic 
review, we focused on "identifying, appraising 
and synthesizing research-based evidence and 
presenting [it] in an accessible format... from 
which conclusions can be drawn and decisions 
made" (Higgins & Green, 2011, para. 1.2.1- 
1.2.2). The review protocol includes specific 
search strategies, including the use of strict in¬ 
clusion and exclusion criteria for each study. 
We followed a systematic review protocol to 
identify strengths and gaps in the literature, to 
provide empirically derived conclusions, and 
to offer suggestions for future studies. 

W e posed 10 specific questions related to the 
research available on VCP. Among all of the 
articles that met our inclusion criteria, we 
sought to answer: 

1. What are the types of articles published 
and what is the relative frequency of each 
type of article? 

2. What are the publication rates over time 
for empirical and nonempirical articles? 
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3. To guide future reviews, what are the 
common terms used in the literature to 
describe live remote psychotherapy via 
videoconferencing and traditional, in- 
person psychotherapy? 

From the included empirical articles, we 
sought to answer: 

4. What formats and types of psychother¬ 
apy have been conducted via videocon¬ 
ferencing? 

5. Which populations have been studied? 

6. What are the primary assessment instru¬ 
ments that have been used? 

7. is VCP feasible? That is, can it be im¬ 
plemented successfully in different for¬ 
mats, with different populations, and us¬ 
ing different types of therapy? M oreover, 
can emotions be conveyed through VC, 
and are costs manageable? 

8. Are there differences in the therapeutic 
relationship when psychotherapy is de¬ 
livered via teleconferencing rather than 
in person? 

9. Are providers and consumers satisfied 
with VCP? 

10. Are the clinical outcome data for VCP 
comparable to in-person psychotherapy? 

Method 

Search Strategy 

To identify eligible articles, we searched the 
PubM ed, PsycINFO, and PILOTS electronic 
search engines. Ten different search combina¬ 
tions were used. We began by combining the 
terms "psychotherapy" and "telemedicine." 
Next, we combined each of the terms "mental 
health,” "therapy,” and "psychotherapy" with 
the terms "video and telehealth," "video and 
telemedicine," and "teleconferencing" (ninead¬ 
ditional searches). We conducted the searches 
on J anuary 27, 2011. We screened all titles and 
abstracts, and we obtained complete reports for 
the articles that appeared eligible for inclusion. 
We examined the reference lists of obtained 
articles for potentially appropriate articles that 
may have been missed in the electronic 
searches. 


Selection Criteria 

We established three inclusion criteria: (a) 
published in English language, (b) published in 
peer-reviewed journals, and (c) focused on live 
VCP (i.e., through specialized video telehealth 
equipment, video phones, or computer moni¬ 
tors). We excluded: (a) search engine results 
lacking an abstract (including letters to the ed¬ 
itor); (b) articles that were focused on psychi¬ 
atric services other than psychotherapy (e.g., 
assessment; consultation, medication manage¬ 
ment in combination with psychotherapeutic 
support); (c) dissertations; (d) nonvideo tele¬ 
phone interventions (e.g., telephone conference 
call group therapy); (e) nonvideo computer in¬ 
terventions (e.g., online psychoeducation); (f) 
self-administered interventions; (g) e-mail in¬ 
terventions; or (h) video therapy that was not 
live (e.g., review of recordings). For the non- 
empirical articles, we allowed literature reviews 
that were not solely focused on VCP (since we 
were aware of none which did so) but had a 
significant discussion of VCP issues. For em¬ 
pirical articles, we required that at least one of 
the following outcomes was reported: therapeu¬ 
tic relationship, satisfaction, clinical outcome 
data, or feasibility. Eligibility of articles based 
on these criteria was determined by a consensus 
of all authors. 

C lassification 

Analysis of all articles. In answering re¬ 
search Questions 1-3, all 65 articles were ana¬ 
lyzed. For Question 1, we classified the types of 
articles as either nonempirical or empirical. We 
divided the nonempirical articles into two sub¬ 
categories: (a) reviews of the literature, or (b) 
descriptions of particular programs. We divided 
the empirical articles into three subcategories: 
(a) uncontrolled studies (encompassing case 
studies, case series, and cross-sectional sur¬ 
veys); (b) controlled, nonrandomized studies; or 
(c) randomized controlled trials (FtCTs). To ad¬ 
dress Question 2, we created bar graphs of the 
nonempirical and empirical articles and visually 
inspected them for patterns. For Question 3, we 
examined each included article by hand to iden¬ 
tify the most frequently used terms in each 
article to describe the two modes of treatment 
(remote video technology and traditional in- 
person therapy). 
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Analysis of empirical articles. Analysis 
for research Questions 4-10 included empirical 
studies only. The 47 empirical studies and their 
sample sizes can be seen in Table 1. Prior to 
answering questions four through 10 we at¬ 
tempted to determine whether different empiri¬ 
cal articles were reporting on the same data set, 
through examining the articles or contacting the 
authors. W e discovered that 10 of the empirical 
articles represented five pairs of studies which 
had overlapping samples (Bouchard etal., 2004 
and Bouchard et al., 2000; Frueh et al2007 
and Frueh et al., 2007; Germain, M archand, 
Bouchard, Drouin, & Guay, 2009 and Germain, 
Marchand, Bouchard, Guay, & Drouin, 2010; 
M arrone, Mitchell, Crosby, Wonderlich, & 

Joilie-Trattier, 2009 and Mitchell et al., 2008; 
M orland et al., 2010 and Greene et al., 2010). 
For the articles with overlapping samples, we 
chose only to include the data from the article 
with the largest sample size (if one was larger), 


and thus, included five of these articles. The five 
excluded articles are noted in Table 1 with an 
asterisk (*). 

For Questions 4-6, we determined percent¬ 
ages based on the total number of samples 
(rather than articles) to avoid double-counting, 
and thus analyzed only the 42 unique samples 
for those topics (i.e., populations studied, for¬ 
mat and types of psychotherapy, assessments 
used). For Question 4, we classified the psycho¬ 
therapy format (individual, group, family, cou¬ 
ples, mixed, undefined) and type (cognitive- 
behavioral therapy [CBT], family therapy, 
substance abuse therapy, eclectic or undefined, 
or other defined therapy). For Question 5, we 
classified the empirical samples by psychiatric 
diagnoses, military status (active duty, Veteran, 
or civilian), and developmental status (child/ 
adolescent, general adult, or older adult). For 
Question 6, we hand-searched each empirical 
article for individual instruments and classified 


Table 1 

Empirical Studies 

Uncontrolled 

Nonrandomized controlled 

Randomized controlled 


studies 

studies 

studies 


Author(s) 

N Author(s) N 

Author(s) 

N 


Bakke et al., 2001 

2 

Bouchard etal., 2004 

21 

Day & Schneider, 2002 

80 

Bischoff et al., 2004 

3 

Cluver et al., 2005 

10 

Frueh, Monnier, Yim et al., 2007 

38 

Bose et al., 2001 

13 

Germain etal., 2009 

48 

‘Frueh, Monnier, Grubaugh etal., 2007 

38 

‘Bouchard et al., 2000 

8 

‘Germain etal., 2010 

46 

Glueckauf et al., 2002 

27 

Cowain, 2001 

1 

Grady & Melcer, 2005 

112 

‘Greene et al., 2010 

112 

Deitsch, et al., 2000 

4 

Harvey-Berino, 1998 

166 

King et al., 2009 

37 

Earles et al., 2001 

3 

Morgan etal., 2008 

86 

*M arrone et al., 2009 

116 

Frueh et al., 2005 

18 

Simpson etal., 2006 

6 

M itchell et al., 2008 

128 

Ghosh et al., 1997 

1 

Tuerk etal., 2010 

47 

Morland et al., 2004 

20 

Goldfield & Boachie, 2003 

1 



Morland et al., 2010 

125 

Griffiths et al., 2006 

15 



Nelson, et al., 2003 

28 

Hill et al., 2001 

2 



Ruskin et al., 2004 

119 


Himle et al., 2006 3 

Kaplan, 1997 2 

Manchanda & McLaren, 1998 1 

Nelson & Bui, 2010 1 

Oakes et al., 2008 1 

Oliver & Demiris, 2010 2 

Passik et al., 2004 8 

Shepard et al., 2006 25 

Shore & M anson, 2004 1 

Simpson, 2001 10 

Simpson et al., 2002 11 

Simpson et al., 2003 12 

Todder et al., 2007 2 

Todder & Kaplan, 2007 1 


* Study is excluded from analysis of research Questions 4- 6 due to having overlapping samples with another study. 
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those as reporting no measures, only nonstan- 
dardized measures, or at least one standardized 
measure. For Questions 7-10, we determined 
the number of articles that addressed each out¬ 
come (feasibility, therapeutic relationship, sat¬ 
isfaction, and clinical outcome data) and 
reviewed the articles in each category to syn¬ 
thesize the conclusions. 

Results 

We identified 728 unique articles from the ini¬ 
tial electronic searches, and the search of reference 
lists yielded an additional 93 unique articles. Thus, 
the total denominator for articles to consider was 
821. A total of 756 articles were excluded. Of the 
excluded articles, 17 (2%) were non-English, 52 
(7%) did not have an abstract, 191 (25%) were not 
focused on psychotherapy, 64 (8%) were non¬ 
video telemedicine, 13 (2%) were nonpeer re¬ 
viewed, 368 (49%) were focused on a discipline 
other than mental health (e.g., radiography, phys¬ 
ical therapy, neurology), and 51 (7%) were ex¬ 
cluded for other reasons (e.g., nontelemedicine, 
self-directed therapy). (Note that due to rounding 
errors, percentages in Results may not always total 
100%). Sixty-five articles were identified as meet¬ 
ing our criteria for inclusion. These articles are 
listed with an asterisk (*) in the Reference section. 

Types of A rtides (Q uestion 1) 

Eighteen (28%) of the 65 articles reviewed 
were nonempirical studies. Of these, eight 
(44%) were literature reviews and 10 (56%) 
offered program descriptions (see Table 2). As 
we anticipated, we did not find any literature 


Table 2 

Nonempirical Studies 


Literature reviews 

Program/Project 

descriptions 

Antonacci et al., 2008 

Cartreine et al., 2010 

Bee et al., 2008 

Egede et al., 2009 

Capner, 2000 

Folen et al., 2001 

Hailey et al., 2008 

Freir et al., 1999 

Hilty et al., 2004 

Gammon et al., 1996 

Monnier et al., 2003 

Kuulasmaa et al., 2004 

Norman, 2006 

M ielonen et al., 2002 

Richardson et al., 2009 

Morland et al., 2009 
Olden et al., 2010 
Wright et al., 1998 


reviews that were solely focused on VCP 
(which was the impetus for the current review); 
therefore, we included the eight reviews that 
included substantial discussions of VCP. There 
have been a number of excellent reviews that 
have discussed psychotherapy via VC, but these 
either presented overviews of some combina¬ 
tion of many psychological service domains 
provided via VC provided via teleconferencing 
(such as assessment, pharmacotherapy, psycho¬ 
therapy, education, consultation, or supervision; 
e.g., Antonacci, Bloch, Saeed, Yildirim, & Tal¬ 
ley, 2008; Capner, 2000; Hilty, Marks, Urness, 
Y el low I ees, & Nesbitt, 2004; Monnier, Knapp, 
& Frueh, 2003; Norman, 2006; Richardson et 
al., 2009), focused on psychotherapy only but 
not only VC (e.g., Bee et al., 2008), or focused 
on neither psychotherapy or VC yet had some 
discussion about VCP (i.e., Hailey, Roine, & 
Ohinmaa, 2008). 

Among the program descriptions are pioneer¬ 
ing overviews of VC (called "two-way TV”) for 
group therapy (Wittson, Affleck, & Johnson, 
1961; Wittson & Benschoter, 1972), a descrip¬ 
tion of a biofeedback telehealth program (Folen, 
James, Earles, & Andrasik, 2001), an overview 
of telehealth psychiatry services provided in 
particular countries (Freir et al., 1999; Gam¬ 
mon, Bergvik, Bergmo, & Pedersen, 1996; M ie- 
lonen, Ohinmaa, Moring, & Isohanni, 2002), a 
description of a university VC program with a 
focus on family therapy (Kuulasmaa, Wahlberg, 
& Kuusimaki, 2004), and a description of VCP 
for caregivers of older adults with dementia 
(Wright, Bennet, & Gramling, 1998). Addition¬ 
ally, there are discussions about the design of 
randomized noninferiority trials (Egede et al., 
2009; Morland, Green, Rosen, Mauldin, & 
Frueh, 2009). The noninferiority trials utilize a 
methodology that will "allow for rigorous com¬ 
parison of VTC [video teleconferencing] and 
in-person modalities and a sophisticated analy¬ 
sis of equivalency (noninferiority) ... used to 
determine if a novel intervention is no worse 
than a standard intervention” (Morland et al., 
2009, p. 514). 

The remaining 47 (72%) articles were empir¬ 
ical studies. There were 21 controlled studies 
(45% of the empirical studies). Nine nonran- 
domized trials (19%) and 12 randomized trials 
(26%) were identified. Twenty-six of the empir¬ 
ical studies (55%) had no control condition for 
comparison. The majority of the uncontrolled 
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studies were case study designs (54%; n = 14) 
(e.g., Cowain, 2001), followed by cross- 
sectional survey designs (35%, n = 9; e.g., 
Simpson, 2001) and case series designs (11%, 
n = 3). Deitsch, Frueh, and Santos (2000) and 
Simpson, M orrow, J ones, Ferguson, and Breb- 
ner (2002) reported on only a single psychother¬ 
apy session for each subject. The mean sample 
size for all of the uncontrolled studies was six 
participants. 

Patterns of Publication Rates (Question 2) 

There were only two articles meeting our 
search and selection criteria that were published 
before 1996 (i.e., Wittson et al., 1961 and 
Wittson & Benschoter, 1972), but there was at 
least one peer-reviewed publication per year 
during the 15 year period of 1996-2010. Figure 
1 excludes the two pre-1996 outliers to illustrate 
the pattern of publication rates for nonempirical 
articles, empirical articles, and their combina¬ 
tion during three year periods since 1996. 

Terms Used (Question 3) 

The most frequently used terms within each 
article to describe the two modes of treatment 
(remote and in-person) were tabulated and the 
summary of the terms is listed in Table 3. The 
most commonly used term to describe the re¬ 
mote mode of treatment was "videoconferenc¬ 
ing" (and variations of that term), representing 
40% of the articles, followed by "telepsychia¬ 
try" (17%) and "telemedicine" (11%). Many 
articles were focused on descriptions of psycho¬ 


therapy only provided via videoconferencing 
(without discussion of in-person psychother¬ 
apy), and many of the empirical studies did not 
offer an in-person control condition. Accord¬ 
ingly, only 28 of the articles used any term for 
in-person psychotherapy. The most common 
terms used were "face-to-face" (often abbrevi¬ 
ated FTF or F2F; 57%), "in-person" (14%), and 
"same room" (11%). 

Formats and Types of Psychotherapy 
(Question 4) 

Regarding psychotherapy formats studied, of 
the 42 unique empirical samples, 71% (n = 30) 
reported an individual therapy format (e.g., 
Bakke, Mitchell, Wonderlich, & Erickson, 
2001), 17% (n = 7) described group therapy 
(e.g., Frueh, Flenderson, & Myrick, 2005), and 
10% (n = 4) discussed family therapy (e.g., 
Hill, Allman, & Ditzler, 2001). The remaining 
sample (2%; Shore & M anson, 2004) combined 
individual and group psychotherapy. None of 
the studies reported using a couples therapy 
format. 

Regarding types of psychotherapy, the largest 
proportion of samples (45%; n = 19) identified 
cognitive- behavioral therapy (including behav¬ 
ior therapy and exposure therapy) as the pri¬ 
mary treatment type (e.g., Bouchard et al., 
2000). Treatment types categorized as either 
eclectic, various, or undefined (e.g., Ruskin et 
al., 2004) comprised 11 (26%) of the empirical 
samples utilized. Three samples (7%) utilized 
VC for various types of family therapy (e.g., 


25 



1996-1998 1999-2001 2002-2004 2005-2007 2008-2010 


■ Non-empirical 

■ Empirical 

■ Total 


Figure 1. Number of nonempirical, empirical, and total articles published during three year 
periods since 1996. 
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Table 3 

Terms for Modes of Treatment Most Frequently Used in Reviewed Articles 

Traditional therapy Remote video technology 


• Face-to-face treatment or face-to-face therapy (16) 

• In-person treatment, in-person therapy (4) 

• Office-based (1) 

• On-site counseling (1) 

• Same-room treatment, same-room therapy (3) 


• Standard therapy, standard behavior therapy 
interventions (2) 

• Traditional therapy (1) 


• Behavioral telehealth (1) 

• Computer-based treatment (1) 

• Interactive video, interactive television (2) 

• Internet-based videoconferencing (1) 

• Remote counseling, remote consultation, remote 
treatment, remote communication technologies, or 
remote methods (1) 

•Telecommunications or telecommunications media (1) 

•Telehealth, telehealth technology, or telehealth-mediated 
delivery (5) 

•Telemedicine or telemedicine methods (7) 

•Telemental health, telemental health services, or 
telemental healthcare (4) 

•Telepsychiatry (11) 

•Telepsychology or rural telepsychology (3) 

•Telepsychotherapy (1) 

•Videoconference, videoconference access, videoconference 
treatment, videoconferencing, videoconferencing utility, 
video-conferencing, video conference, video 
teleconferencing, or video-conferencing technology (26) 

•Videophones (1) 


Note. Numbers in parentheses indicate how frequently a term was the primary term used in an article. 


Hill et al2001), and two (5%) focused on 
substance abuse treatment programs (e.g., King 
et al., 2009). For the remaining seven articles 
(17%), there was one study for each of the 
following specific treatment types: biofeedback 
(Earles, Folen, & James, 2001), Dignity Ther¬ 
apy (Passik et al., 2004), hypnosis (Simpson et 
al., 2002), psychoanalysis (Kaplan, 1997), Eye 
Movement Desensitization and Reprocessing 
(Todder & Kaplan, 2007), Problem Solving 
Therapy (Oliver & Demiris, 2010), and "Cop¬ 
ing Skills for PTSD” (Morland, Pierce, & 
Wong, 2004). 

Populations Studied (Question 5) 

As noted, there were 42 unique empirical 
samples. Among these, 36 (86%) studied adults, 
and one of these was identified as an older adult 
population (60 years and older). Four of the 
samples (10%) were composed of children 
and/or adolescents and two (5%) were mixed or 
unclear ages. Regarding military status, 31 em¬ 
pirical samples (74%) were civilian (nonmili¬ 
tary) populations, nine samples (21%) were 
composed of Veterans, and the remaining two 
samples (5%) combined civilian and military 


participants. There were no studies of active 
duty service members meeting our inclusion 
criteria. 

A cross the 42 samples, the majority (n = 39) 
reported data on sex of participants. Among the 
samples that reported the sex of participants, 
nearly 60% of participants were male (approx¬ 
imately 800 participants) while female partici¬ 
pants (approximately 550 participants) ac¬ 
counted for just over 40%. Only 23 of the 42 
unique samples included in our review reported 
race or ethnicity of study participants, and 14 of 
the 23 (61%) had samples where at least half of 
the sample was Caucasian. Notable exceptions 
included three studies in which a majority of the 
sample was African American (55%, Frueh et 
al., 2007), Hispanic (100%, Nelson & Bui, 
2010), or American Indian (100%, Shore & 
Manson, 2004). These studies supported the 
feasibility and effectiveness of VC in these sam¬ 
ples. 

Regarding the clinical problems addressed, 
nine of the samples (21%) were composed of 
individuals diagnosed with trauma disorders 
(post traumatic stress disorder and acute stress 
disorder). Nineteen percent of the sample pop- 
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ulations (n = 8) had general or mixed present¬ 
ing problems. Twelve percent (n = 5) of the 
sample were comprised of individuals with eat¬ 
ing disorders (such as anorexia nervosa and 
bulimia nervosa). The remaining clinical targets 
were: mood disorders (n = 3; 7%); anxiety 
disorders other than posttraumatic stress disor¬ 
der and acute stress disorder (n = 3; 7%; two 
panic disorder with agoraphobia and one obses¬ 
sive-compulsive disorder); addiction issues 
(n = 3; 7%); pain/psychophysiological issues 
(n = 3; 7%); adjustment to cancer (n = 3; 7%); 
other (n = 3; 7%; family issues, gender reas¬ 
signment, and caregiver stress); and mixed de¬ 
pression and/or anxiety (n = 2; 5%). 

Assessments Used (Question 6) 

Of the 42 unique samples from the empirical 
studies, seven (17%) did not list any measures 
used, and all of those articles described uncon¬ 
trolled studies. Nonstandardized measures, 
including qualitative questionnaires and inter¬ 
views (e.g., Bakke et al., 2001; Bischoff, Hol- 
list, Smith, & Flack, 2004; Simpson et al., 
2002), and author-created measures (e.g., Clu- 
ver, Schuyler, Frueh, Brescia, & Arana, 2005; 
Deitsch et al., 2000; H arvey-B eri no, 1998; King 
et al., 2009) were used by 11 (48%) of the 
articles. At least one standardized measure with 
well-accepted psychometrics was reported 
by 29 (69%) of the empirical studies. The most 
common measures were versions of the Beck 
Depression inventory (BDI; e.g., BDI-II; Beck, 
Steer, & Brown, 1996), which was cited in 10 
different articles; the Working Alliance Inven¬ 
tory (WAI; Horvath & Greenberg, 1989), which 
was cited in nine different articles; and the 
Structured Clinical interview for the DSM-IV 
(SCID-IV; SCID-I; First, Spitzer, Gibbon, & 
Williams, 1996), which was cited in six differ¬ 
ent articles. 

Feasibility (Question 7) 

The authors in each of the articles reviewed 
indicated that VC was a feasible means to de¬ 
liver psychotherapy. As noted above, VCP has 
been successfully used in several formats using 
various types of psychotherapy. Researchers re¬ 
ported the successful expression and interpreta¬ 
tion of emotions via VC (Bischoff et al., 2004; 
Cluver et al., 2005; Deitsch et al., 2000; Frueh 


et al., 2005; Griffiths, Blignault, & Yellowlees, 
2006; Hill et al., 2001; M anchanda & M cLau- 
ren, 1998; Oliver & Demiris, 2010; Simpson, 
2001; Simpson et al., 2002). Moreover, pro¬ 
grams offering telehealth services may realize 
decreased costs for patients in terms of time and 
travel expenses (Davalos, French, Burdick, & 
Simmons, 2009; Grady, 2002). Eighteen of 
the 47 empirical studies (38%) explicitly ad¬ 
dressed how this mode of treatment can contrib¬ 
ute to reductions in travel burdens and costs, 
reduced intervention costs, and/or increased ac¬ 
cess to care for rural, underserved, or geograph- 
ically isolated populations. 

Therapeutic Relationship (Question 8) 

Of the 47 empirical articles, 16 (34%) exam¬ 
ined the patient-provider relationship in ther¬ 
apy. Fourteen of these studies concluded that 
patients and providers perceive a strong thera¬ 
peutic alliance over VC (e.g., Bouchard et al., 
2000; Ghosh, McLaren, & Watson, 1997; Mor¬ 
gan, Patrick, & Magaletta, 2008; Simpson, 
2001), comparable to in-person sessions (Ger¬ 
main et al., 2010). Some patients discussed 
enhancement of the therapeutic relationship 
during VC (Simpson, 2001). However, in one 
family therapy group (Glueckauf et al., 2002) 
and in another group therapy setting (Green et 
al., 2010), the patients reported lower therapeu¬ 
tic alliance with the provider when using VC 
compared to those who received treatment in 
person. In the Glueckauf et al. study, teens with 
epilepsy and their parents rated the quality of 
the therapeutic relationship across three modal¬ 
ities (face-to-face in office, by speakerphone, 
and by VC). The parents rated the therapeutic 
relationship as good across the three modalities 
(and there were no differences among the mo¬ 
dalities). The teens, however, reported that in 
the VC condition the therapeutic alliance was 
weaker. The authors speculated that the neuro¬ 
psychological deficits that can co-occur with 
epilepsy may have made it difficult to encode 
and interpret social interactions in that format. 
In the Green et al. study of group anger man¬ 
agement therapy provided face-to-face in office 
or by VC, the participants (male Veterans) in 
both conditions rated therapeutic alliance as 
high (over 4 on a 5-point scale, suggesting 
agreement with positive statements about the 
relationship), but there was more variance in the 
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VC condition and the ratings in the VC condi¬ 
tion were significantly lower than the face-to- 
face condition. While ratings of alliance did 
predict clinical outcomes for individuals, the 
mean ratings within conditions did not medi¬ 
ate outcomes between the conditions (in 
which VC was not inferior to face-to-face 
treatment). The authors posited that alliance 
may have been impacted by the nature of the 
treatment (a long, intense, group-based inter¬ 
vention) or patient-specific factors (such as 
comfort with technology or treatment his¬ 
tory). As with the Glueckauf et al. study, it is 
possible that group interventions via VC may 
be challenging for some individuals due to the 
potential for increased distractions and com¬ 
peting stimuli (e.g., the presence of other 
people in the room and video equipment in 
the room). 

Satisfaction (Question 9) 

Twenty-six of the 47 articles (55%) exam¬ 
ined patient and/or provider satisfaction. In 
studies without a comparison group, researchers 
often concluded that users were generally satis¬ 
fied when engaging in psychotherapy over tele¬ 
medicine (Deitsch et al., 2000; Frueh et al., 
2005; M yers, Valentine, & M elzer, 2008; Simp¬ 
son, Bell, & Britton, 2006; Simpson et al., 2003; 
Simpson et al., 2002), and studies that com¬ 
pared VC to in-person psychotherapy reported 
similar satisfaction levels between the condi¬ 
tions (Cluver et al., 2005; King et al., 2009; 
Morgan et al2008; Nelson, Barnard, & Cain, 
2003; Ruskin et al., 2004). When sources of 
dissatisfaction arose, they primarily involved 
technical challenges, but such issues appeared 
to have little impact on overall satisfaction lev¬ 
els (e.g., Cowain, 2001; Folen et al., 2001). 
Both the patient-provider relationship in ther¬ 
apy and patient and/or provider satisfaction was 
reported in seven (15%) of the studies. 

Clinical Outcome Data (Question 10) 

For our final research question, we sought to 
determine if the clinical outcome data for VCP 
iscomparableto in-person psychotherapy. Sixty 
percent (n = 28) of the 47 articles examined 
clinical outcomes. We have organized the re¬ 
sults into five general categories of clinical 
problems studied in those 28 articles: depres¬ 


sion and/or anxiety (including posttraumatic 
stress disorder and acute stress disorder), eating 
disorders, physical problems, miscellaneous, 
and addictions. We draw particular attention to 
the outcomes from randomized empirical stud¬ 
ies. 

Ten of the 47 empirical articles (21%) pre¬ 
sented clinical outcome data on anxiety and/or 
depression (see Table 4). Two randomized em¬ 
pirical studies (Nelson et al., 2003; Ruskin et 
al., 2004) reported no significant differences 
between in-person conditions and VCP condi¬ 
tions for symptoms of anxiety and depression, 
with both conditions showing symptom im¬ 
provement. interestingly, Nelson and col¬ 
leagues (2003) found the V C P group to have a 
faster decline in depressive symptoms as com¬ 
pared to the in-person group. These outcomes 
are supported by less rigorous studies that re¬ 
ported improved clinical outcomes for VCP pa¬ 
tients with anxiety and/or depression. Posttrau¬ 
matic stress disorder was specifically examined 
by Frueh etal. (2007) in a RCT and by Tuerk, 
Yoder, Ruggiero, Gros, & Acierno (2010), and 
Germain et al. (2009) in nonrandomized com¬ 
parisons studies. While the two nonrandomized 
studies found no major differences between the 
in-person groups and the VCP groups (both 
groups demonstrated clinical improvements), in 
the randomized study neither group had signif¬ 
icant changes in their posttraumatic stress dis¬ 
order (PTSD) symptoms. 

Six of the 47 empirical articles (13%) pre¬ 
sented clinical outcomes for patients with eating 
disorders (see Table 5). M itchell et al. (2008) 
was the only study with a randomized compar¬ 
ison between in-person treatment and VCP. 
Their results indicated that both the in-person 
and VCP groups had similar treatment retention 
and both showed clinical improvements, includ¬ 
ing reduced binging and purging frequencies 
and abstinence from binging and purging be¬ 
haviors. Flowever, the in-person group had a 
statistically greater reduction in eating-related 
distorted cognitions than the VCP group. The 
in-person group experienced a greater reduction 
in self-reported disordered eating-related cogni¬ 
tions and depressive symptoms, although the 
authors noted that, "the differences overall were 
few in number and of marginal clinical signifi¬ 
cance" (Mitchell et al., 2008, p. 581). These 
results are supported by the additional studies 
examining clinical outcomes for eating disor- 
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Table 4 

Clinical Data: Depression and Anxiety Disorders 


Study 

Problem 

Outcomes 

Type of 
study* 

Bouchard et al., 2000 

Panic w/agoraphobia 

(-) Panic attacks (severity and frequency), 
panic apprehension, severity of disorder 
(+) Global functioning, perceived self-efficacy 

EU 

Cowain, 2001 

Anxiety & depression 

(+) Functioning 
(-) Depression/anxiety 

EU 

Manchanda & McLaren, 1998 

Anxiety & depression 

(-) Anxiety/depression 

EU 

Himle et al., 2006 

OCD 

(-) OCD symptoms 
(+) Global functioning 

EU 

Bouchard et al., 2004 

Panic w/agoraphobia 

M ajority of both groups free of panic 
symptoms 

EN 

Germain et al., 2009 

PTSD 

Both conditions: 

(-) PTSD, anxiety and depression 
(+) Overall functioning and perceptions of 
physical and mental health 

EN 

Tuerk et al., 2010 

PTSD 

Both conditions: 

(-) PTSD symptoms 
(-) Depression 

EN 

*Frueh, Monnier, Grubaugh, 
et al., 2007 

PTSD-combat 

Neither modality had significant changes in 
symptoms 

ER 

Nelson et al., 2003 

Depression 

All modalities were effective at (-) depression; 
VCP group had faster decline of symptoms 

ER 

Ruskin et al., 2004 

Depression/anxiety 

No significant differences between conditions, 
both had: 

(-) Depression/anxiety 
(+) Health and GAF 

ER 


Note. EU = Empirical Uncontrolled; EN = Empirical Nonrandomized Control; ER = Empirical Randomized Control. 


ders, which generally reported improvements in 
symptom presentation. 

Four of the empirical studies (9%) addressed 
outcomes related to a variety of physical health 
concerns (see Table 6). The only RCT focused 
on patients with epilepsy (Glueckauf et al 
2002). Results indicated no significant differ¬ 
ences between the in-person and VCP groups, 
and both showed clinical improvement. The re¬ 
maining studies found VCP to have positive 
outcomes for patients with chronic pain and 
irritable bowel problems (Earles et al., 2001), 
cancer (Shepherd et al., 2006), and obesity 
(Harvey-ESerino, 1998). 

Five of the empirical studies found positive 
outcomes for miscellaneous clinical areas such 
as parent- child problems, gender reassignment, 
mood disorders, adjustment, and anger (see Ta¬ 
ble 7). In the only RCT, Morland and others 
(2010) found VCP to be just as effective as in 
person for treating individuals with anger diffi¬ 
culties. 

Three of the empirical studies (6%) provided 
clinical outcome data for addiction related prob¬ 


lems, including alcohol, substance abuse, and 
gambling (see Table 8). All three studies indi¬ 
cated that VCP was an effective method for 
delivering addiction focused interventions. 

Discussion 

The aims of this systematic review were to 
identify, synthesize, and interpret the literature 
on VCP by using a predefined search and selec¬ 
tion protocol to answer 10 specific questions. 
We will discuss the issues relevant to each of 
the 10 questions we posed. 

Types of A rtides (Q uestion 1) 

Among the 65 articles selected for review 
were 18 nonempirical studies, split almost 
evenly between literature reviews and program 
descriptions. None of the reviews focused 
solely on VCP, but they provided rich discus¬ 
sions and analyses of issues that are relevant to 
VCP. The program descriptions can be useful 
guides to individuals who are interested in the 
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Table 5 

Clinical Data: Eating Disorders 


Study 

Problem 

O utcomes 

Type of 
study* 

Bakke et al., 2001 

Bulimia nervosa 

Absence of binge/purge at follow-up 

EU 

Goldfield & Boachie, 2003 

Anorexia nervosa 

(+) Weight 

Improved medical condition 

EU 

Simpson et al., 2003 

Eating disorders 

(-) Symptoms 

(+) Nutritional knowledge 

(+) Nutritional content of diet 

EU 

Simpson et al., 2006 

Bulimia nervosa 

(-) Binging (for half (6) of participants) 

(-) Purging (for 1 participant) 

(-) Depression (for 5 participants) 

(-) Borderline symptoms (for 4 participants) 

EN 

M arrone et al., 2009 

Bulimia nervosa 

Operating characteristics analysis: Reduction in 
binge eating at 6th week is associated with best 
outcomes for VCP; 8th week for in person 

ER 

M itchell et al., 2008 

Bulimia nervosa 

Both conditions had similar retention rates 

Both groups showed clinical improvements, but in 
person group had slightly greater (-) in 
distorted cognitions and depression. 

ER 


Note. EU = Empirical Uncontrolled; EN = Empirical Nonrandomized Control; ER = Empirical Randomized Control. 


logistics of beginning clinical work or research 
in the field. There were 47 empirical studies 
since 1996, representing nearly three quarters of 
the articles reviewed. However, the methodol¬ 
ogy in many of the extant studies was weak, and 
these limitations make it difficult for providers 
and researchers to replicate and compare re¬ 
sults. Over half of the studies presented uncon¬ 
trolled data (e.g., case studies, case series, 
cross-sectional surveys) with small samples, 
which could allow a number of untested con¬ 


founding variables to influence the results. In 
our experience, it is easier to enlist participants 
for traditional in person psychotherapy than for 
VCP, so it is likely that control subjects could 
be recruited for most studies of VCP. 

Several of the studies had reported on shared 
samples. It was not always clear from the writ¬ 
ten reports when samples were overlapping, 
which would result in an apparent inflation in 
the quantity of studies. In fact, only 42 unique 
samples were studied and only 21% of those 


Table 6 

Clinical Data: Physical Problems 


Study 

Problem 

Outcomes 

Type of 
study* 

Earles et al., 2001 

Chronic pain & irritable bowel 

(-) Pain 

(-) Pain medication 
(-) Bowel irritability 
(+) Ability to relax 
(+) Outlook 
(+) Mood 

EU 

Shepard et al., 2006 

Cancer 

(-) General distress 
(-) Anxiety 

(+) Wellbeing (emotional, functional, physical) 

EU 

Harvey-Berino, 1998 

Obesity 

Both groups: 

(-) Weight 

(+) Eating behaviors, exercise 

EN 

Glueckauf et al., 2002 

Epilepsy 

(-) In problem severity, frequency 
(+) Prosocial behaviors 

ER 


Note. EU = Empirical Uncontrolled; EN = Empirical Nonrandomized Control; ER = Empirical Randomized Control. 
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Table 7 

Clinical Data: Miscellaneous 


Study 

Problem 

Outcomes 

Type of 
study* 

Ghosh et al., 1997 

Gender reassignment 

(+) Social and clinical adjustment 

EU 

Nelson & Bui, 2010 

Parent-child problem 

(+) Anger management skills 

(+) Parenting skills 

(+) Parent-Child Communication 

EU 

Grady & Melcer, 2005 

Variety (mood, anxiety, 
personality) 

Both groups showed improvement in: 

GAF and medication compliance but VCP was 
significantly better than in person for both 

No differences between groups in #of labs ordered, 
self-help recommendations made, #of patients 
prescribed 2 or more medications 

EN 

Day & Schneider, 2002 

Variety (e.g. family problems, 
body/image) 

No significant differences between modalities 
(speaker phone, in person, VCP) in therapeutic 
process or outcomes 

ER 

Morland et al., 2010 

Anger 

No significant differences between modalities: 

(-) Anger symptoms 

ER 


Note. EU = Empirical Uncontrolled; EN = Empirical Nonrandomized Control; ER = Empirical Randomized Control. 


had subjects randomized to condition. More¬ 
over, some studies reported nonmanualized or 
blended interventions (e.g., psychotherapy and 
pharmacotherapy; individual and group ther¬ 
apy) and mixed diagnostic groups. M any of the 
controlled studies described differences be¬ 
tween VC and in-person conditions but ne¬ 
glected to discuss the statistical or clinical sig¬ 
nificance of within-group changes. The majority 
of the controlled studies presented superiority 
designs, and these were generally underpow¬ 
ered due to small sample sizes, potentially miss¬ 
ing true differences between conditions. The 
lack of statistical differences in these studies 
does not mean that outcomes from VC and 
in-person are identical, and non inferiority and 
equivalence designs offer an alternative to the 
standard approach (Greene, Morland, Durkal- 


ski, & Frueh, 2008). As Richardson etal. (2009) 
stated with regard to V C for interventions more 
broadly, the evidence base for VCP remains 
underdeveloped. 

Patterns of Publication Rates (Question 2) 

Within the parameters of our search criteria, 
we found only two publications focused on 
VCP prior to 1996, reflecting that this area of 
study is in early stages. Consistent with the 
observation that general telemental health pub¬ 
lications have increased rapidly in recent years 
(Richardson et al., 2009), we found a similar 
(though less pronounced) pattern of increased 
publications on VCP. The number of nonem- 
pirical articles published from 2008 to 2010 
equaled the sum of all such publications from 


Table 8 

Clinical Data: Addiction 


Type of 


Study 

Problem 

Outcomes 

study* 

Frueh et al., 2005 

Alcohol 

(+) Participant alcohol abstinence 

EU 

Oakes et al., 2008 

Gambling 

(-) Indicators of problem gambling 
(+) Work adjustment 
(+) Social adjustment 
(-) Depression/anxiety 

EU 

King et al., 2009 

Substance abuse 

No significant differences between groups: 

(+) Abstinence and attendance 

ER 


Note. EU = Empirical Uncontrolled; EN = Empirical Nonrandomized Control; ER = Empirical Randomized Control. 
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1996 to 2007. Similarly, the number of empir¬ 
ical publications from 2002 to 2010 was nearly 
triple such publications from 1996 to 2001. 
During each of the 3-year periods starting in 
1996, the number of empirical publications has 
outpaced the nonempirical publications, sug¬ 
gesting that future years may continue that trend 
and bring additional original data to guide work 
in this field. The total number of publications 
demonstrates a near-linear trend of more fre¬ 
quent publications in recent years, and the most 
recent three years together represent a third of 
all publications in the past 15 years. 

Terms Used (Question 3) 

Several of the review articles included in this 
review appeared to equate telehealth, telemental 
health, e-health, or telepsychiatry with VC (A n- 
tonacci et al., 2008, noted that these terms are 
often used interchangeably). Multiple terms 
were used within many articles to denote psy¬ 
chotherapy via remote video technology, and 
often the term used in the title of an article was 
not the term used most frequently in the body of 
the text. As the field has developed, it has be¬ 
come more important to be precise in technical 
terminology for mental health services provided 
remotely to convey specifically what format 
was used and to ensure inclusion of relevant 
studies in literature reviews. 

Many of the empirical studies we reviewed 
did not offer an in-person control condition, but 
when it was discussed, traditional in-person 
psychotherapy was most often referred to as 
"face-to-face." The terms "in person" and 
"same room" were less frequently used, but we 
argue that these terms are more descriptive 
(since in VC, participants are also "face-to- 
face" onscreen), and thus, we have used the 
term "in person" in this article. "Videoconfer¬ 
encing" was the most commonly used term to 
describe remote treatment, so a search for that 
term should yield the most appropriate articles 
on the topic. We encourage other researchers 
who focus on this mode to use that term rather 
than more generic terms. "Videoconferencing" 
has the advantage of being more precisely de¬ 
fined (it is more specific than the terms "tele¬ 
health" or "telemedicine"), and it includes im¬ 
ages and sounds conveyed through different 
types of equipment such as video phones and 
computers. We chose the term "Videoconfer¬ 


encing Psychotherapy" for this review because 
it conveys the type and remote mode of treat¬ 
ment most efficiently and accurately. After we 
had conducted our review, we realized that be¬ 
fore the terms "telemedicine" and "telehealth" 
were in wide use, the technology was some¬ 
times described as "two-way TV" or "interac¬ 
tive TV" (e.g., Wittson, Affleck, & Johnson, 
1961; Wittson & Benschoter, 1972), so those 
terms should be included in future searches for 
VCP. 

Formats and Types of Psychotherapy 
(Q uestion 4) 

The literature covered a range of treatment 
types and therapy formats, with the largest pro¬ 
portion of studies utilizing individual CBT to 
investigate VCP. Nearly one half of the psycho¬ 
therapies studied were described as CBT. Al¬ 
though CBT is a broad term that can encompass 
a wide range of techniques, there is clear evi¬ 
dence that manualized treatments like CBTs can 
be conducted via VC. Group, couples, and fam¬ 
ily therapy present some particular technical 
challenges and possibilities for providers choos¬ 
ing to use VC technology, and more studies of 
psychotherapies in these formats are necessary 
to inform providers about these issues. Over a 
quarter of the empirical studies did not define 
the intervention or described eclectic psycho¬ 
therapies. Clear descriptions of established 
treatment protocols will advance the knowledge 
base by helping clinicians and researchers rep¬ 
licate and extend the work that has been done. 

Populations Studied (Question 5) 

VCP has been applied to individuals with 
many clinical conditions. The largest category 
of problems addressed was trauma disorders 
(including PTSD and acute stress disorder). The 
next largest category of clinical conditions stud¬ 
ied was general or mixed presenting problems. 
While such heterogeneous samples may be eas¬ 
ier to recruit, it is challenging to interpret find¬ 
ings of mixed diagnostic groups. VCP may be 
particularly well suited to trauma disorders. One 
of the hallmarks of PTSD is avoidance of un¬ 
comfortable situations that may remind the per¬ 
son of the traumatic event, and, in our own 
work, some individuals with PTSD have told us 
that psychotherapy by VC offers a more com- 
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fortable therapeutic distance between them and 
the provider as the therapeutic relationship is 
being established (Thorp, Fidler, Moreno, 
Floto, & Agha, 2012, pp. 198-199). Patients 
may be initially reluctant to disclose personal 
information, even to mental health professionals 
(Olden et al., 2010). Telehealth can encourage 
patients to exchange more information with the 
provider since they feel less intimidated than 
during in-person interactions (Kavanagh & Yel- 
lowlees, 1995; Tachakra & Rajani, 2002; Woot- 
ton, Y el low I ees, & McLaren, 2003). in fact, 
some patients rated telehealth higher than in- 
person encounters in terms of ease of self- 
expression (Chae, Park, Cho, Flung, & Cheon, 
2000). There is a need for more data describing 
VCP with generalized anxiety disorder, pho¬ 
bias, and personality disorders, as these disor¬ 
ders may pose particular challenges or benefits 
in this modality (e.g., maintaining clinical fo¬ 
cus; maintaining therapeutic alliance; conduct¬ 
ing specific exposure therapies at a distance). 

There were four VCP studies of children 
and/or adolescents, but only one description of a 
largeRCT (in progress) of VCP for older adults 
(Egede et al., 2009). Richardson et al. (2009) 
notes that, given potential limitations in trans¬ 
portation and mobility, older adults in particular 
may benefit from mental health services by 
VCP. Flowever, older adults may also have dis¬ 
comfort with using VCP equipment, and may 
have sensory impairments (e.g., difficulty hear¬ 
ing) that could interfere with that mode of treat¬ 
ment (Jones & Ruskin, 2001). In our own work, 
we have found that older adults can become 
more comfortable with the VCP format with 
time, and with hearing difficulties communica¬ 
tion may be improved with headphones or a 
zoomed lens on a therapist's lips (Thorp, et al., 
this issue). 

While there appears to be an adequate bal¬ 
ance of men and women included in studies of 
VCP, there is a need for greater attention to 
potential differences in process variables and 
outcomes related to sex of participants. Few of 
the studies reported results separately by sex or 
had hypotheses or analyses focused on sex dif¬ 
ferences. Thus, the lack of focus on this issue 
could reflect that there truly are no differences 
in feasibility, satisfaction, alliance, and clinical 
outcomes or it could reflect a lack of attention to 
this topic. It is certainly possible that sex could 
influence feelings of alliance in the video format 


or comfort with technology generally, so it ap¬ 
pears that the issue is deserving of more empir¬ 
ical analysis. 

There have been few studies of telemental 
health that address ethnic and racial differences 
among participants and how it impacts services, 
and these have focused primarily on assessment 
services (Richardson et al., 2009). M ore studies 
with a focus on potential racial and ethnic dif¬ 
ferences would be worthwhile. M inorities may 
face greater obstacles to accessing empirically 
based psychotherapies, and thus VCP has the 
potential to increase access for these groups. 
Cross-cultural studies could inform how com¬ 
fort with the technology may differ across cul¬ 
tures. 

Assessments Used (Question 6) 

M any of the studies we examined used mul¬ 
tiple standardized instruments to assess broad 
domains of clinical and process variables. Flow¬ 
ever, over one third of the empirical studies we 
reviewed reported either nonstandardized mea¬ 
sures or no measures at all. While customized 
measurement (unstructured interviews and au¬ 
thor-created instruments) may augment stan¬ 
dardized instruments, the field is sufficiently 
advanced to demand psychometri cal ly sound 
instruments be used in all empirical studies of 
VCP. We surveyed the most common instru¬ 
ments used across studies (full list available on 
request) to guide future providers and research¬ 
ers, and found that the BD1 was the most pop¬ 
ular choice (reflecting the studies of mood dis¬ 
orders and comorbid mood symptoms). The 
WAI was used often to contrast therapeutic 
alliance between modes of treatment, and the 
SCID was conducted to confirm psychiatric di¬ 
agnoses. The broad use of these measures with 
established reliability and validity suggests that 
they are good choices for many VCP studies. 

Feasibility (Question 7) 

The extant literature shows that many psy¬ 
chotherapy types have been delivered through 
VC, and these psychotherapies have addressed a 
wide range of clinical problems. Importantly, 
studies generally agreed that participants are 
able to express and interpret emotions through 
the live video format. M any of the researchers 
noted that only minimal changes were required 
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to conduct psychotherapy via VC. indeed, pri¬ 
marily what is absent in VCP is the ability to 
use senses of touch and smell, which are used 
sparingly in most psychotherapies. There are 
some differences in the quality of the visual and 
auditory stimuli that are available through VC 
(see Thorp, et al., this issue; e.g., more limited 
visual range, potential for visual or auditory 
artifacts such as grainy images and delayed 
sounds), and these possibilities should be dis¬ 
cussed with patients at the outset of treatment in 
this modality. M oreover, crisis procedures must 
be modified because the therapist will not be in 
the same room. This includes the therapist 
knowing the phone number and address of the 
patient location and having a clear plan in place 
with the patient and clinical personnel at the 
remote location (Thorp et al., in press). 

The term feasibility can encompass many 
domains, and more than a third of the studies 
addressed specific facets of feasibility (e.g., 
costs, access). The field has advanced to a point 
where procedures and measurement could be 
established to monitor these particular aspects 
of feasibility. It will be important for future 
studies to more precisely define what type of 
feasibility is being measured, so that researchers 
and clinicians can evaluate the feasibility of 
VCP by settings, psychotherapy formats, psy¬ 
chotherapy types, populations, cost, logistics, 
and access. 

Therapeutic Relationship (Question 8) 

One third of the studies we reviewed ex¬ 
amined the quality of the therapeutic relation¬ 
ship in VCP. Most found that therapeutic 
alliance was strong in VCP, and in most of the 
controlled studies the ratings of therapeutic 
alliance was found to be equivalent between 
VCP and in-person psychotherapy. However, 
a few articles reported an enhanced (Simpson, 
2001) or diminished (Glueckauf et al., 2002; 
Green et al., 2010) alliance via VCP. Future 
studies could investigate how alliance is in¬ 
fluenced by population type (e.g., rapport may 
be more difficult to establish with some diag¬ 
noses), therapy format (e.g., individual vs. 
group), or technology used (e.g., standard 
videoconferencing equipment, video phones, 
online teleconferencing). 


Satisfaction (Question 9) 

Slightly more than half of the studies we 
included in our review assessed satisfaction, 
and these generally found that patients and pro¬ 
viders were satisfied with the format despite 
occasional frustrations with technical issues. 
Satisfaction with videoconferencing will likely 
improve as audio and video technology ad¬ 
vances. The use of satisfaction as an outcome 
has been criticized due to limitations in study 
methodologies (Mair & Whitten, 2000; Nor¬ 
man, 2006; Richardson et al., 2009). For exam¬ 
ple, many of the studies have not included a 
control condition, making it difficult to differ¬ 
entiate satisfaction with the format from satis¬ 
faction with the treatment. Additionally, au¬ 
thors have created many customized measures 
of satisfaction with unclear psychometric prop¬ 
erties, and the lack of standardization of the 
measures makes it difficult to compare results 
across studies. In addition to general satisfac¬ 
tion, it is important to measure sources of sat¬ 
isfaction (e.g., convenience, therapeutic dis¬ 
tance) and dissatisfaction (e.g., audiovisual 
problems; feeling disconnected), it is recom¬ 
mended that, when satisfaction is included as an 
outcome variable in VCP studies, reliable and 
valid measures of satisfaction should be used, 
the measures should allow for some detail about 
sources of satisfaction and dissatisfaction and 
should serve as an adjunct to other clinical 
outcome measures, and control conditions 
should be included when possible. 

Clinical Outcome Data (Question 10) 

Two-thirds of the studies examined clinical 
outcome data. A cross the broad range of cl i nical 
problems that were addressed, the researchers 
reported that care provided via VCP worked 
well, and the Nelson et al. (2003) study con¬ 
cluded that it worked a little faster than in 
person treatment. As we have suggested, it is 
possible that individuals with different psychi¬ 
atric diagnoses may differentially respond to 
treatment via VC, but the numbers of studies for 
different diagnoses remain too small for mean¬ 
ingful meta-analyses of those differences to be 
performed. I n addition, as we have noted, many 
of the studies have suffered from weak meth¬ 
odological design and small sample sizes. 
M oreover, for some studies it was unclear if the 
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interventions produced statistically or clinically 
significant changes (in either condition, if a 
control group was utilized). 

Conclusions and Recommendations 

Telehealth can encompass many technolo¬ 
gies, and there are many mental health services 
that have been delivered by telehealth, includ¬ 
ing assessment, psychoeducation, training, con¬ 
sultation, and supervision. Current advances in 
technology, including telehealth in general and 
VCP in particular, offer an innovative solution 
to the mental health provider shortage in rural 
areas and for some specialties. Based on the 
growing literature base of VCP, we concluded 
that the more focused field of psychotherapy via 
videoconferencing was mature enough to merit 
a systematic review. We sought answers to 10 
general questions about VCP. Overall, the liter¬ 
ature regarding the provision of VCP has been 
expanding and the general findings are support¬ 
ive of VCP as a treatment option. It appears 
clear that video telehealth is feasible, at least in 
some contexts and in some situations. The data 
also suggest that most users of the technology 
(both patients and providers) are satisfied with 
this mode of treatment for psychotherapy. Thus, 
there is some preliminary outcome evidence 
that VCP is a viable alternative to in person 
therapy, but further research is needed in this 
area. 

Several important issues have not been ad¬ 
dressed systematically or commonly within the 
VCP literature and were outside the planned 
scope of our review. We did not address liabil¬ 
ity, issues about consent, sense of control, legal 
issues, reimbursement issues, ethical issues, 
contraindications, or regulatory and licensure 
issues, but we have cited excellent reviews that 
discuss these issues in telehealth generally. We 
noted that within VC treatment studies, the clin¬ 
ical impact of gender and ethnoracial factors on 
outcomes remains unclear. More diverse sam¬ 
ples are needed to ensure adequate power to test 
hypotheses about these variables. We did not 
conduct a meta-analysis of clinical outcomes 
because there are only 21 controlled studies to 
analyze and nine of these did not randomly 
assign participants to condition. 

As Frueh et al. (2000) and Schopp et al. 
(2006) have suggested, it is important to con¬ 
sider whether successful video telehealth pro¬ 


grams can be sustained. Sustainability will be 
influenced by ongoing provider training, patient 
education, maintenance and upgrading of equip¬ 
ment, and reimbursement of health care pro¬ 
vided through videoconferencing. The adoption 
of new technologies, such as smart phones with 
interactive video, may encourage the use of 
VCP. However, these technologies may also 
generate new issues of crisis management, lia¬ 
bility, and confidentiality. 

We agree with Frueh et al. (2004) that the 
field of telepsychiatry is young, and, therefore, 
more efficacy studies, with strong internal va¬ 
lidity, are recommended. M ost standard clinical 
trial approaches are designed to examine differ¬ 
ences rather than equivalence or noninferiority 
in outcomes, but because we do not expect 
meetings by VC to be superior to meetings in 
person, the latter designs are more appropriate. 
Although small clinical trials with low statisti¬ 
cal power have been useful for demonstrating 
adequate and general feasibility and satisfaction 
with VCP, such trials are unlikely to show true 
differences in clinical outcomes between VCP 
and in-person care. These trials lack the statis¬ 
tical power to provide real evidence of equiva¬ 
lence or noninferiority (Greene et al., 2008). 
Randomized noninferiority designs may offer 
stronger evidence that VCP is as good as in- 
person treatment. Noninferiority trials establish 
what would constitute clinically significant dif¬ 
ferences in outcomes and test whether one treat¬ 
ment produces results that are clinically nonin¬ 
ferior to another (standard) treatment, but these 
trials often require large sample sizes (M orland 
et al., 2010). 

In conclusion, VCP shows great promise as 
an alternative to traditional in-person psycho¬ 
therapy, and improvements in technology will 
make this modality more accessible. However, 
many of the recommendations of Frueh et al. 
(2000) still hold today: there remains a need 
for additional large scale, randomized clinical 
outcome trials which will provide important 
information about the efficacy, and eventually 
effectiveness of VCP (including process vari¬ 
ables, clinical outcomes, relative rates of at¬ 
trition, and cost-effectiveness). The stronger 
studies will have large sample sizes, standard¬ 
ized measurement of variables of interest, 
well operationalized treatment protocols, and 
measures of treatment adherence, attrition, 
therapeutic alliance, feasibility, satisfaction, 
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and clinical outcomes of these services for a 
variety of populations. 
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